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ABSTRACT 

Nine papers presented at a research conference an 
strategies for teaching Giathematics are presented in this volume. The 
first paper provides an overview of research on teaching strategies, 
defining a perspective on the subsequent papers- The second paper 
reviews the major strategies frou a historical perspective* The third 
paper discusses the role of a theory in the development of teaching 
strategies- Four papers are concerned with research problems related 
to teaching strategies. The first of these deals with studies of 
efficacy of different strategies; the second concerns a comparison of 
teaching strategies ^rhich differed in the amount of information being 
taught and the amount of pupil*teacher interaction, Hore general 
research papers concern problems of designing studies of teaching 
strategies and a context for studying teaching strategies from a 
delive* *'-syste ms approach. The eighth paper discusses materials for 
teacher training- The final paper provides an integrative summary of 
research on teaching strategics- (SD) 
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MATHEMATICS ElftJCATlON HEPORTS 

T\\e. Mathematics EduCnfition Reports series makes available recent 
analyses ^jnd syntheses of research and development efforts i-n machematlcs 
education. We are pleased to make available as part of this series the 
papers frc>m the Workshop on Teiiching Strategies sponsored by the Georgia 
Center for the Study of Learning and Teaching Mathematics » 

Other Mathematics Education Reports make available information 
concerning mathematics education documents analyzed at the ERIC 
Information Aiialysis Center for Science* Mathematics, and Environmental 
Education. These reports fall into three broad categories. Research 
reviews sutnmariKc and analyze recent research in specific areas of 
mathematics edv^cation. Resource guides identify and analyze materials 
and references for use by mathematics teachers at all levels. Special 
bibliographies announce the availability of documents and review the 
literature in selected Interest areas of mathematics education. Reports 
in each of these categories may also be targeted for specific sub- 
populations of the mathematics education community. 

Priorities for the development of future Mathematics Education Reports 
are established by the advisory board of the Center* i(i cooperation with 
the National Council of Teachers of Mathematics ■ the Special Interest 
Group for Research In Mathematics Education* and other professional 
groups in mathematics education. Individual comments on p^ast Reports and 
suggestions for future Reports are always welcomed by the ERIC/SMEAC Center. 

Jon L. Hlgglns 
Associate Director 
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AckPQWledgemetits and Overview 



The Georgia Center for the Study ot Learning and Teaching Mathematics 
(GC5LTM) was started July 1, 1975, through a founding grant from the 
National Science Foundation. Various activities preceded the founding 
of the CC5LTH.. The moat significant was a conference held at Columbia 
University in October of 1970 on Piagetian Cognitive-^Development and 
Mathematical Education. This conference was directed by the late Myron 
F. Rosskopf and Jointly sponsored by the national Council of Teachers of 
Mathematics and the Departntent of Mathematical Education, Teachers 
College, Columbia University with a grant from the National Science 
Foundation.. Following the October 1970 Conference, Professor Rosskopf 
spent the winter and spring qiiarters of 1971 as a visiting professor of 
Mathematics Education at the Universitv of Georgia.. During these two 
qiiarters, the editorial work wad compl«±ted on the proceedings of the 
October conference and a Letter of Intent was filed in Febriiary of 1971 
with the National Science Foundation to create a Center for Mathematical 
Education Research and Innovation* Professor Rosskopf's illness and 
untimely death made it impossible for him to develop rhe ideas contained 
in that Letter. 

After much discussion among faculty in the Departmenr of Mathematics 
Educ^^tion at the University of Georgia, it was clear that a center devoted 
to the study of mathematics education ought to attaek a broader range of 
problems than vas stated in the Letter of Intent. As a result of these 
discussions* three areas of study were identified as being of primary 
interest in the initial year of the Georgia? Center for the Study of 
Learning and Teaching Mathematics — Teaching strategies. Concept Develops 
m^nr^ and Problem Solving. Thomas J. Cooney assumed directorship of the 
Teaching Strategies Project, Leslie P. Steffe the Concept Development 
Project, and Larry L. Hatfield the Problem Solving Project. 

The GCSLTM is intended to be a long-term operation with the broad 
goal of improving mathematics education in elementary and secondary schools 
To be effective, it was felt that the Center would have to include 
mathematics educators with interests commensurate with those of the 
project areas. Alternative organizational patterns were avi^ilable — 
resident scholars, institutional consortia, or individual consortia. 
The latter organizational pattern was chosen because it vas felt maximum 
participation would be then possible. In order to ope rationalize a 
concept of a consortia of individuals, five research workshops were held 
during the spring of 1975 at the University of Georgia. These workshops 
were (ordered by dates held) Teaching Strategies, Number and tteasurement 
Concepts, Space and Geometry Concepts, Models for Learning Hathematics, 
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and Problem Solving. Papers were commissioned for each workshop, tt 
wad necessary to commission papers for two reasons. First, current 
analyses arid syntheses of the knovledge In the particular areas chosen 
for Investigation were needed. Second, a catalyst for further research 
end development activities was needed — major problems had to be 
Identified In the project areas on which work was needed. 

Twelve working groups emerged from these workshops; three In 
Teaching Strategies, five In Concept Development, and four In Problem 
Solving. The three working groups In Teaching Strategies are: Differential 
Effects of Varying Teaching Strategies, John Dossey, Coordinator; 
Development of Protocol Materials to Depict Moves and Strategies, Kenneth 
Retzer, Coordinator; and Investigation of Certain Teacher Behavior That 
May Be Associated with Effective Teaching, Thomas J. Cooney, Coordinator* 
The five working groups In Concept Development are: Measurement Concepts, 
Thomas Romberg, Coordinator; Rational Number Concepts, Thomas Kleren, 
Coordinator; Cardinal and Ordinal Number Concepts, Leslie P. Steffe, 
Coordinator; 5; .ce and Geometry Concepts* Richard Leah, Coordinator; and 
Models for Learning Mathematics* William Ceeslln, Coordinator. The 
four working groups In Problem Solving are: Instruction In the Use of 
Key Organizers (Single Heuristics), Frank Lester, Coordinator; Instruction 
Organized to use Heuristics In Combinations « Phillip Smith* Coordinator; 
Instruction In Problem Solving Strategies, Douglas Crouws, Coordinator; 
and Task Variables for Problem Solving Research, Gerald Kulm, Coordinator. 
The twelve working groups are working as units somewhat independently 
of one another; As research and development emerges from working groups, 
It Is envisioned that some working groups will merge naturally. 

The publication program of the Center Is of central Importance to 
Center activities. Research and development monographs and school mono- 
graphs will be Issued, when appropriate, by each working group. The 
school monographs will be written In nontechnical language and are to be 
aimed at teacher educators and school personnel. Reports of single 
studies may be also published as technical reports. 

All of the above plans and aspirations uould not be possible If it 
were not for the existence of professional mathematics educators with 
the expertise In and commitment to research and development in mathematics 
education. The professional comaltment of mathematics educators to the 
betterment of mathematics education in the schools has been vastly under- 
estimated. In fact, the basic premise on which the CCSLTM Is predicated 
is that there are ^ significant number gf professional mathematics 
educators with a great deal of Individual commitment to creative scholar- 
ship. There is no attempt on the part of the Center to buy this scholar- 
ship — only to stimulate It and provide a setting m which It can flourish. 
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The Center administration wishes to thank th^ individuals who wrote 
Che excellent papers for the workshops^ the^ participants who made the 
wortcshops possible* and the National Science Foundation for supporting 
fiaancialiy the first year of Center operation. Various individuals have 
provided valuable assistance in preparing the papers given at the work- 
shops for publication. Mr. David Bradbard provided technical editorship; 
Mrs. Julie Uetherbee* Mrs. Elizabeth Piatt, Mrs. Kay Abney* and Mrs. Cheryl 
Hirstein, proved to be able typists; and Mr. Robert Petty drafted the 
figures. Mrs. Julie Uetherbee also provided expertise in the daily 
operation of the Center during its first year. One can only feel grateful 
for the existence of such capable and hardworking people. 



Thomas J. Cooney 
Director 
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Leslie P* Stefte 
Director 
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and 

Director, GCSLTM 



Larry L. Hatfield 
Director 
Problem Solving 
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Rasaatch oti Teaching Sttateglest 
An Introduction 
Thomas J. Cooney 
University of Georgia 



The Teaching Strategies Project has as Its main objective the study 
of teaching and teacher training.. In particular* the project Id concerned 
with logical aspects of teacher behavior and the vay In Which these aspects 
may relate to effective teaching.. The work of the Teaching Strategies 
Project originated In the theory of teaching advanced by Smith and 
Henderson.. The papers In this collection focus on theory and research 
concerning the teaching of matheinatlcs and possible directions for further 
research.. In this Introduction, the contents of the papers are highlighted 
and promising research on teaching mathematics that was done outside the 
project Is Identified and discussed. 

Hyinan (1971) described teaching as a trladlc relationship* Involving 
a. teacher* at least one pupil* and the subject matter to be taught and 
learned. Henderson (1971) provided a more formalized conceptualization of 
teaching by Interpreting teachlng as a ternary relation T(3c* y* z).. To 
Henderson* the domain of x constitutes "sequences of 'actions' of an object 
which. In tenns of some criteria*"" Is Identified as a teacher" (p. 137). 
The domain of y Is the set of' teachable objects. The domain of z according 
to Henderson Is "sequences of actions or behaviors of a person who. In 
terms of some set criteria. Is Identified as a learner" (p. 138). It Is 
clear that the domain of z Is a factor Influencing the conscious actions 
of a teacher, as teachers behave differently with respect to the nature of 
the learner and the learner's respective actions. An artistic teacher 
alters, his or her teaching strategies according to his or her perception 
of the status of Che learner as evidenced by the learner's behaviors. 

Although not as obvious, the domain of y Is also a factor In determining 
the strategies a teacher utilizes. Henderson (1972) made the following 
observation with reference to the nature and Influence on teaching of 
the domain of y: 

One can hypothesize that the kind of teachable object 

(value of y) makes a difference In teaching (value of x) 

just as the kind of behavior of the student (value of z) 

does. Surely a tescher should go about teaching an Item 

of analytic knowledge or belief differently than he would 

an Item of empirical knowledge or belief.. And just as surely 

a teacher should draw a distinction between a factual state- 

ment and a value judgment and hence teach chem differently, (p. 4) 
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To illustrate, consider three items of knowledge commonly found in 
secondary school jnathematics . 

1*^ Rhombus 

2. A rhofmbus is a parallelogram with two adjacent sides congruent. 

3. The diagonals of a rhombus are perpendicular. 

Consider, novf, vfhat a teacher might do in teaching these items of knowledge.. 
For item 1 it makes sense to point to a specific object that represents 
or does not represent a rhombus.. &ut it does not make sense to point to 
a specific object and say that it does or does not represent items 2 or 3.. 
This is because the referent of item 1 is a collection of objects whereas 
the other tvfo items involve truth functional statements. &ut these two 
statements differ also.. In 2 a common definition of a rhombus is given.. 
As such, the statement is true by agreement or stipulation. In 3, however, 
the truth of the statement is predicated on the truth of other assertions — 
some definitional and somo deduced from previously established statements. 
The nature of the teachable object in each case will determine* in part, 
how a teacher behaves ^nd the nature of the teaching strategy selected. 

It is generally recognized that teachers must have extensive knowledge 
of both subject matter and basic psychological principles applicable to 
classroom instruction.. What is not as readily recognized is the relevance 
of epistemology in determining a teacher's behavior^ As Henderson 
pointed out, the nature of the knowledge being taught also determines a 
teacher's actions.. Smith (1969)i in discussing this third kind of knowledge! 
wro te : 

It has only recently been recognised that there is another 
sort of knowledge that can influence the performance of a 
teacher; that used In thinking about the subject matter and 
the logical operations used in manipulating it., (p.. 125) 

The point is that a teacher is potentially better able to facilitate 
student achievement if he or she is aware of the type of knowledge — e.g.., 
beliefL^, conceptSi and principles-'being taught and the various logical 
operations — e..g.., exemplifying, comparing and contrasting, describing, 
characterizing, classifying, inferring, explaining. Justifying^ abstracting, 
generalizing, and applying — used in manipulating each type of knowledge.. 
With reference ro understanding the various types of knowledge and the 
ways in which they c^*n be manipulated. Smith (1%9) observed; 

Because teachers do not now possess such understanding they 
frequently handle the subject matter of instruction in superficial 
ways. Consequently, class discussion often suffers from 
undue vagueness and ambiguity^ from unfounded and unchallenged 
claims, from a failure to develop the significance of the 
content. Cp. 126) 

11 
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Hence, It seems that research related to <a) explicating various forms 
of maCbematical ictiowledgej Cb) explicating ways of presenting knowledge, 
and <c) identifying effective means of conveying different types of knowledge 
to teachers is essential for the development of a theory of teaching 
mathematics* Some groundvork for such research has already been completed 
by scholars who have theorized and explicated various types of knowledge* 
viz., mathematical concepts* principles* and skills. Some researchers 
have provided detailed and carefully defined descriptions of teachers' 
actions when teaching mathematical concepts* principles* and skills* 
Others have conducted empitical investigations dealing with the efficacy 
of various teaching strategies as defined in terms of the desctiptive work 
of previous research. 



The Necessity of Studying Teachine — Or — 
Trying to Avoid Ostrichism 



If various journals reporting research on teaching or on teacher 
education are reviewed, there are several observations one might make. 
Depending in part on how various research studies are categorized> it 
appears that relatively fev studies have focused on teaching behavior* on 
the identification of principles for effective teaching, or on related 
problerns in teacher education* A second striking factor is that studies 
investigating these problem areas have little common theoretical frame- 
work connecting them* This is not a criticism of the studies. In almost 
every case, the study is a solid piece of work and represents an extensive 
effort by the researcher. The lack of a common theoretical framework is 
not unique to research on teaching and, is in fact characteristic of most 
research in mathematics education. <A concern for the lack of such a 
framework Is essentially the raison d 'etre of the Georgia Center for the 
Study of Learning and Teaching Mathematics*) 

To some the paucity of research on teaching can be attributed to 
the belief that a teacher's effectiveness is primarily contingent upon 
attitudes and personality attributes of the teacher end influential factors 
in the child's home environment. Indeed* there is some empirical evidence 
to support these beliefs* Berliner (1975) noted that for subjects such 
as reading and social studies home influences are very powerful and could 
account for a substantial amount of the variance of student achievement. 
Berliner went on to point out that ii^ subject areas not commonly learned 
at home, notably the sciences, socioeconomic conditions account for less 
variance than in reading* social studies, or language arts. Berliner (1975) 
concluded that there is more variance in acheivement of the sciences to 
be attributed to school and teacher effects (p. 16)* 



12 



-4^ 

Still, some argue Chat teaching Is an art and that efforts to subject 
it to scle^itific Inquiry are futile. Davis (1967) subscribed to the 
following position: 

My proposition, ob\;iously. Is that the process of teaching 
Is the -practice of an art. It Is not the application of a 
science in ^^^y presently meaningful sense of such a phrase: 
and the suggestion that it is must be labelled as, at best, 
a conspicuous instance of wishful thinking, (p. 38) 

Gallagher (1970) made the following statements with respect to whether 
the artistry of teaching precludes scientific Investigation. 

Is teaching an arc? Indeed it is^ Perhaps too much of 
one. Surgery was once coo much ^n art and many people 
died ad a result. Cooking is an art» and while few people 
die of it these days, drugstores do a thriving business 
In remedies for misbegotten creative culinary efforts. 
For when a set of skills Is in a developmental latage where 
' people say, "it Is an art*" they mean several things. Firsts 
that there are only a very few persons who hawe the skills 
that can ^dentify them as highly effective practitioners* 
as '"artists." Second^ even these artists cannot give a 
systematic account of how they practice their art^ and they 
are reduced to modeling their performance for those who 
would learn from them^ But It Is hard to Imitate the true 
artisti and his genius too often dies with him. 

Those interested In the improvement of education and teaching 
would like to remove some of the mystery of the art of effective 
teaching through systematic study, (p. 30) 

Mo thoughtful person would argue that mathematics teaching is not an 
art. The question is not whether mathematics teaching is an art but 
whe':her it is amenable to scientific inquiry. The position of the. Teaching 
Strategies Project Is that mathematics teaching can and will be improved 
through the elucidation of both analytic and empirical principles*^ Such 
principles can be identified through analyses of theoretical positions* 
descriptive investigations* and tightly controlled e^cperlmental studies. 

Many artistic endeavors are subject to improvement as a result of 
scientific Inquity^ Consider the field of athletics* Clearly an athletic 
event embodies the emotions of its participants. Indeed* emotions are 
sometimes a critical factor in an aChlete^s performance. Further, some 
athletes are more gifted, i.e.* artistic* than L^i.hers. "iet each athlete 
must adhere to some fundamental principles of performance, or the potential 
benefit of emotions and artistry will be greatly diminished. For the 
most part these principled are teachable and constitute Items of 
instruction for coaches. 

Probably no argument, however rational snd eloquently stated, will 
change one's opinion on whether the teaching of mathematics should be 
studied in Its own right. The controversy can and should be resolved 
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ot^ly when evidence is available concerning che existence or nonexistence 

of principles fo^ Improving the teaching of m^ithematlcs . The conceptualization 

that began with Smith anO Henderson has resulted in both evidence and 

promise for the continueci search for such principles* Elaboration of 

Chat evidence and promise is one of the primary consicieratioiis of this 

monograph. 

From one perspective there is little choice but to continue such 
research. That perspective relates to the advent and proliferation of 
competency based teacher education programs. Few would argue agairist the 
construct of competency based teacher education, (Is its complement 
incompetency based teacher education?) Yet the main hiatus in competency 
based teacher education is the dearth of reliable research that would 
identify maxims for teaching mathematics effectively. In view of che 
tens of thousands of students aspiring to become mathemarjca teachers and 
Che profess-Lon's commitment to better teacher education programs, it seems 
reasonable and desirable to expand and coordinate research efforrs. Brophy 
<1975) put it tbis way. 

Teacher educators and educational researchers need to pay more 
attention to the accumulation of a dat^.^ base thaC would allow 
truly prescriptive teacher education to emerge. Propounding 
Ideas on the basis of commitments rather than supportive data 
is uiiscientific to say the least, and blowing with the wind by 
propounding the latest educational fad is even worse. Cp. 15) 

Rerliner <1975) has lamented the state of the art in competency based 
teacher education prograjns and teacher accountability systems. His comments 
below doubtless apply to some extent to all* teacher education programs. 

Ostrichism Is a common disease often afflicting education* 
Its etiology is a premature commitment to a parCicular 
educational movement- Behavioral symptoms include the 
practice of sticking one^s head in the sand when problems 
fippear^ in the hope that the problems will go away. (p* 1) 

The goal of the Georgia Center in general and of the Teaching Strategies 
Project In particular is to begin the arduous task of doing coordinated 
research* The justification for the workshop in teaching strategies* for 
which the papers In this monograph vere commissioned* is the belief that 
the development of a theory of teaching mathematics would be facilitated 
by developing a coordinated research program* To date^ most studies on 
teaching strategies have been dissertation studies. Although such studies 
can make significant contributions to knowledge about teaching mathematics* 
dissertation studies do not constitute the coordinated program of research 
that Is necessary for the formulation of a theory. The Teaching Strategies 
Project intends to provide a catalyst for the identif icaCions of a program 
of research. 
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A Perspective on the Papers 



The papers in this monograph represent the thinking of individuals 
Integrally involved in research on teaching mathematics. The purpose of 
this section is to mention and comment on particularly Important points 
made by the various authors. Although the comments are» In a sense» 
specific to the Teaching Strategies Project* they also express concerns 
that apply to much educational research. 

Smithes paper provides a context for understanding the historical 
development of the Project^s current research. In addition to the Interesting 
historical perspective* Smith summarises several points that distinguish 
research In this project. One such point i&_ the relevance of eplstemology 
to the teaching act, that is» the nature of the knowledge being taught 
is a determining factor In how one should teach*. This entails differentiating 
a teacher^s interaction with content from his interaction with students.. 
This distinction Is a vital consideration for research*. 

Another point Smith makes is that since two variables — clarity and 
acceptance of pupil responses— have heen Identified as related to student 
achievementt there Is promise that others can be Identified. Perhaps so. 
"Clarity'* Is an Interesting variable*. The construct "clarity" has not 
been adequately characterized — Its behavioral manifestations are not well 
defined and must be inferred as one observes teaching. The quef^tlon arises 
as to how this variable Is relevant to the Teaching Strategies Project*. 
Is is possible » for example* to view clarity In the uay that moves and 
strategies occur In teaching behavior? This topic will be explored^'iJti' 
greater detail later In this paper. ^ 

Henderson^s paper provides a basis for understanding and appreciating 
the evolution and contribution of pedagogical theory in teaching mathe- 
matics. His contribution* in concert with Smithes, Identifies a unique 
characteristic of the project. The work of these two scholars and theorists 
provides the backdrop for the continuing research on moves and strategies 
in teaching mathematics. 

Henderson makes several Important suggestions concerning additional 
research. An especially intriguing suggestion concerns the diagnostic 
ability of mathematics teachers. As one reviews the literature on research^ 
on teaching* the large number and complexity of variables involved In the 
teaching process become Increasingly apparent (In sotDe ways painfully so)*. 
Probably no single dimension will account for effective teaching. If 
research on teaching points to anything It points to the reasonableness 
of this conjecture. This suggests that effective teaching ndy be related 
to a teacher *s ability to recognize and react to specific classroom 
behaviors — In short» a teacher^s diagnostic ability*. The question then 
arises ^s to the extent to which a teai:her's ability to Identify and 
differentiate various interactive styles (teacher — student-^teacher* etc*.) 
can be described in terms of moves and strategies as these constructs are 
cutrently defined. 
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Hendersoa raised several questions in his or^l presentation at the 
workshop that bear reiterating: 

1. To what extent can research findings generalize across teachers^ 
pedagoglc^^l approaches, or o'ther subject areas? 

2. To what extent should analytic work be done regarding the 
set of Dsachable objects? 

3. Do research findings translate Into textbook writings, classroom 
teachirig practiced, or both? 

Since most research on teaching has been conducted by people not associated 
with mathematics education, the first question strikes at the heart of 
what we might claim to know about teaching mathematics. Henderson <ln his 
oral presentation) stated that a theoretical approach to teaching should 
be based on the logic of various subject areas rather than on general 
psychological factors. This does not preclude the possibility, of course, 
that variables identified through educational research outside mathematics 
might have relevance to re£:earch on teaching mathematics* But It does 
raise the issue of what we can justifiably claim to know about the teaching 
of mathematics when our evidence Is based on research Tiot explicitly 
Involved with mathematics. 

The second question posed above focuses on the detennlnatlon of the 
type of research that should be given priority In teaching strategies 
research* A great deal of analytic work has already been done In explicating 
the teaching of concepts » generalizations, and skills by Glnther (1965) » 
Pavelka (1973), Semllla (1971), and Todd (1972), Other researchers have 
described how teachers justify knowledge (Wolfe, 1969) and how teachers 
help students organize knoweldge (Cooney & Henderson^ 1972), For the most 
part these studies Involved an interaction of logical considerations and 
analysis of teaching behavior. 

At what point should such analytic work continue or yield Co 
empirical Investigations? Turner, In his oral presentation at the workshop, 
seemed to suggest that any additional analytic work on- the models for 
teaching concepts^ generalizations, and skills should be based on a need 
established by empirical evidence. Future research will probably not be 
entirely analytic or empirical* Bather these two types of research will 
likely emerge In concert with one another. The empirical research by 
Dosaey and analytic work on explicating indicators of student learning 
represent two dlfferenct yet mutually supportive research efforts. 

The question of whether research findings translate into textbook 
wrltlngai classroom teaching practices, or both Is especially relevant to 
the research conducted by Dossey and Swank, Both investigators studied what 
Turner refers to as monadic strategies. The strategies In Dossey's treatments 
were expressed through programmed instruction and hence were carefully defined 
with greater confidence to the differences in the strategies employed. 
If a series of stu^iles were to Identify strategies that seemed particularly 
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effective in a controlled setting, one might then ask whether they were 
also effective in the complex world of the classroom*. Essentially the 
approach is one of doing *Wcrocosmj c" research in the hope that significant 
findings will em^^rge vhich will yield effective teaching principles in 
the "macrocosm*' of claescoom interactions* Dossey's investigation of the 
effects of various strategies aci^oss different types of concepts is 
particularly interesting* 

Swank's primary objective, identifying effective teaching strategies* 
is the same as Dossey's, Bar the approach is different, Wi^ereas Dossey 
examined specific and well-defined strategies* Swank examined the totality 
of the moves used in teaching concepts* In partlc<jlar, he investigated 
the differential effects of a strategy having a "high*' number of moves versus 
one having a "low" number of moves at two levels of classroom interaction* 
Should these "gross'* strategies result in differential effects* then 
refinements of these strategies could be defined and investigated* 

Swank did the teaching himself and used the school maCheciacics concept 
of function. These two features of the study made it more representative 
of classroom teaching. Yet Svfank^s strategies iDust still be classified 
as monadic since they vfere determined a priori and hence could not be 
completely sensitive to student responses* As Turner pointed out^ a truly 
dyadic strategy complicates an experiment a great deal and can greatly 
escalate the cosr. 

The work of Dossey, Swank, and others doing similar studies can 
provide an empirical justification for pedagogical theory* Further^ 
their research suggests several areas worthy of Investigation* For example* 
Swank found that the treatment Involving a high level of interaction 
facilitated achievement for higher ability students but not for lower ability 
students* Swank conjectured that the lower ability students may have been 
somewhat threatened by a higher amount of verbal Interaction. This suggests 
that aptitude treatment interaction studies might be done in which the 
nature of the strategy is varied along with student characteristics. 

Dossey suggested that the *'power'* of various moves be atudied. 
Investigations might be conducted in a clinical setting where more detailed 
observations could be made regarding how various moves are received by 
students* Soviet educational psychologists use ^ methodology referred 
to as the "teaching experiment" in which the experimenter observes how 
Students Interact with the content as the teaching process proceeds* The 
"research product*' is the qualitative aspects of student behavior observed 
by the experimenter* This methodology has a great deal of promise for 
the type of research Dossey suggested. 





Turner's contribution suggests a way to structure research In teaching 
strategies* The need for such structure in all areas of educational 
research becomes increasingly more obvious as one reviews the literature- 
Merrill and Wood (197^) have also devised a scheme to structure research* 
Their model is based on four facets of instruction: learner aptitudes* 
subject matter content* Instructional strategies, and instructional 
delivery systems* Although the two schemes are not entirely Isomorphic* 
Merrill and Wood's facets relate closely to Turner's four primary 
domains: teachable objects, teacher actions, student attributes, and 
student indicators of learnlngi^ 

Turner siiggests not only a structure but also steps researchers can 
take to provide more precise experiments and coordination between experi- 
ments. He gives particular attencion to problems related to defining 
and structuring elements within a domain and reducing known sources of 
variance within an experimental treatment* 

One problem deserving attention is the construction of sampling frames 
ior teachable objects. The large and heterogeneous class of teachable 
objects presents a real problem to anyone trying to generalize research 
findings* Without homogeneous classes of teachable objects, it is 
difficult to determine whether a finding involving a particular concept 
or principle is specific to that knowledge or whether It can be generalized 
to other concepts or principles* Analytic work involving. the construction 
of homogeneous classes of teachable objects constitutes a desirable and 
in some sensei necessary project for those involved in research on teaching* 

Another area worthy of consideration is the explication of different 
types of levels or indicators of student achievement for the various 
teachable objects. Turner's suggestion that Indicators could be based 
on moves for teaching concepts, generalizations* and skills has In fact 
already been done — at least to some extent. Cooney, Davis, & Henderson 
(1975), in discussing the evaluation of student performance, use moves 
for teaching as the vehicle for assessing learning* The development of 
a hierarchy of moves and hence learning outcomes has not been done, 
however. 

Turner makes the point that experimenters comparing treatments — for 
example, Dossey and Swank — should strive to inake the various strategies 
equivalent in clarity and content* The less this equivalence Is achieved, 
the more the comparison among treatments Is compromised* For example, the 
determination of the differential effects of a characterization — exempli- 
fication — characterization (ECE) strategy versus an exemplification- 
characterization — exemplification (ECE) strategy is meaningful only if the 
strategies are equivalent In clarity and in the content of the moves 
comprising the C moves and the E moves* If one strategy is clearer than 
the other or If one gtoup of C moves contains more information then 
another set of C moves, then the desired comparison is confounded* Concerns 
of this nature permeate much of educational research* Cronbach (1966) 
criticised experiments involving expository and discovery teaching because 
of biases in favor of the richness of the discovery treatments* 
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Turner also questions how one selects the strategies to be investigated, 
Obvlrjusly* the number of possible viable strategies is very large. In 
some studies » the strategies have been selected co correspond to the 
strategies teachers use in the classroom. This was the approach taken t>v Swank, 
Others — for example, Gaston and Kolb (1973)— selected strategies that typify 
various theoretical approaches co instruction. Still a rationale for 
the selection of moves and strategies is not yet altogether clear. Turner 
suggests that an alternative approach E>e considered; training teachers 
to use nK>ves in their teaching. The comparison then becontes one of 
contrasting the effectiveness of teachers who have had such training with 
teachers who have not. 

This approach has some appeal* For one thing» the erisuing treatments 
would then incorporated a dyadic definition of teaching. Perhaps a teacher 
who has been trained to use a variety of moves will be more effective than 
one who has not. Further, if certain student behaviors correlate with 
certain teacher behavlorst aa Gregory and Osborne's (1975) work suggests^ 
then one can ask whether a teacher's knowledge of moves is reflected in 
his or her students' behavior in claiis. If research follows this vein^ 
and eventually it will, then the work of Retzer and others developing 
Protocol materials will become increasingly significant, 

Retzer's development and research activities can be characterized in 
tecnvs of Turner*s domains. For Retzer, the first domain (teachable objects) 
consists of knowledge of moves, second domain (teacher actions) involves 

protocols and other types of delivery systems designed to teach the knowledge 
of moves. The third domain (student attributes) deals with the attributes 
of the trainee, e,gv^ whether the teacher is preservice or inservice. 
The fourth domain (student indicators of learning) deals with evidence 
that the trainee can in fact utilize knowledge of moves. The fifth domain 
(setting variables) constitutes the nature of the training progranit the 
institution, and other aspects of the context of the delivery system. 

Thus* research on delivery systems would constitute th^ selection of 
content (domain 1), a method of presenting that content (domain 2) with 
respect to the natute of the subjects in the sample (domain 3) » and 
ctiterion measures for asaessing outcomes (domain 4), In many respects 
the concerns raised above regarding research on identifying effective 
teaching strategies also apply to research on identifying effective 
delivery systems for knowledge of moves. Research of this type touches 
on an essential characteristic of competency based teacher education programs. 
Competency based programs are necessarily concerned with means of training 
ptospective teachers to demonatrate certain desired and specified behaviors. 

Research of the type Retzer suggests identifies the concern of how to 
determine if trainees have knowledge of moves and can utilize them in a 
teaching situation. To some extent one can use paper-and-pencil activities 
to ascertain knowledge of moves, Paper-and-pencil techniques^ however, 
are inadequate to assess teaching ability. The problem is complicated 
pattly because of what Retzer refers to as the "can do/will do" question. 
One can assess what a teacher can do tinder certain specified conditions. 
But whether a teacher will do in a classroom teaching situation what he 
can do is an open question. There i^ also the confounding issue of values. 
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A teacher niight be able to use a certain technique but decide not to. 
This involves the teacher's valoe system, A teacher's values roay be soch 
that A certain move or procedure is consciously selected out. This presents 
a most difficult problem in evaluating teaching behavior < It is difficult 
to determine whether a teacher cannot use a move or strategy or whether 
h6 or she has elected not to u^e It, 

Retzer points out that protocol materials are one means of teaching 
moves and pedagogical concepts. Gliessman emphasizes the necessity of 
developir.g protocol materials if research is to permit replication and 
interpretation. Hence, the development of protocol and training materials 
is and should be an important objective of this project. Because of the 
importance of developing protocols, several points raised by Etetzer and 
Gliessman deserve mention. The first relates to the problems of producing 
materials, and the second relates to subsequent research involving the 
mate rials, 

Gliessman emphasizes several key points f.o be considered in producing 
materials. One is to avoid materials which rely on multiple media. 
According to Gliessman, film materials that require a lot of printed 
material to explain their use are not likely to be used. Further, the 
materials should be brief and flexible. Extensive written materials 
generally result in vague and ambiguous concepts for the viewer. Of course, 
the pedagogical concept being depicted must itself be clearly defined 
with specific behaviotal indicators or else the protocol is compromised 
from the start. Another point made by Gliessman is the desirability of 
producing materials with high technical quality and relatively free of 
noise. Materials that are well planned and conceptualized but are of poor 
technical quality generally will not be used by educators. Further, 
protocols must also be relatively free of noise when illustrating various 
concepts. ^ For example, a technically superior film involving the use of 
counterexamples will not be well received if it also contains poor 
teaching practices. Viewers will likely focus oh those poor practices 
to the exclusion of the concept being illustrated. An examination of 
various protocol films suggests that this is a nontrivial point. 

One last point relates to the selection of a medium, 6*g.i film or 
film strips, for illustrating the concept. Gliessman urges that the 
full range of media be considered. In part, his advice is spurted by 
a cost-benefit question. Since high quality products can range anywhere 
from $AO0 for a ten-minute film strip to $12,000 for a ten-minute color 
motion picture* one roust ask whether the benefits of a color motion 
picture warrant the extensive tost. The answer, in part, involves 
research on expected outcomes of using protocol materials. For example, 
in considering printed material such as transcripts or textbooks, audio- 
tapes or movie filmsi one can ask which of these is superior in promoting 
observational skills, a teacher^s use of moves, or other possible outcomes. 
At some point these questions should be dealt with by the producers of 
protocol materials. 
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Suydam's message, most welcome and worthy of consideration, is that 
research not specifically related to teaching strategies might reveal 
interesting questions and Insights concerning our research.. In fact» in 
the next section^ additional issues In educational research will be raised 
thst are relevant to the Teaching Strategies Project.. In ^ sense» 
Suydam's comments cause one to reflect on the more global aspect of this 
project * 

Suydam ask.s about the type of organization iiaplicit in research on 
teaching strategies.. To dare most of the research on rhe differential 
effects of various strategies has been concerned with expository teaching.. 
But the models do not dictate one type of teaching behavior. The models 
depict wayj* in which a teacher can "int^tacr" with the content.. Although 
the sequence of moves—assertion, instance, instance^ instance, instance — 
suggests an expository strategy^ the sequence~-instance» instance^ 
instance, instance^ assertion-*suggest? a discovery approach or perhaps 
s laboratory approach where the instances are modeled in concrete objects* 
Hence, the moves can exemplify a variety of instructional modes* 

The following sequence of questions raised by Suydam are basic to 
research on teaching strategies: 

1* Does having teachers focus on specific types of language help 
students in achieving certain educational goals related to that language? 

2* l^at Inanguage patterns do teachers use? 

3^ IJhat is the effect of these patterns on students* performance? 

The study that gave rise to these questions was conducted by Gregory 
(1972). Gregory sought to establisha relationship between a teacher's 
use of conditional logic and seventh-grade students' conditional 
reasoning ability.. The report by Gregory and Osborne (1975) contained 
evidence that the relationship might exist* It is known that teachers 
vary in their use of moves for teaching concepts and principles.. The 
pattern of these occurrences is still being investigated* If relationships 
between patterns of language and cognitive* or affective, outcomes can be 
identified, an educationally significant finding would be revealed* 
The pattern of the language might be ascertained by qualitative or 
quantitative aspects of moves and strategies. Or the pattern might be 
described by socae other constructs* such as variability or clarity* 
that could be at least partially described in terms of moves or strategies.. 

Suydam raised other Issues that also deserve consideration.. Her 
emphasis on the role Chat questions play in teaching and In learning is 
well taken* Another issue la the need for researchers to communicate how 
terms are being used so better interpretations across studies can be made.. 
Efer suggestion that language patterns of teachers other than mathematics 
teachers be considered as a way of enlightening our insights into the 
teaching of mathematics is yet another issue worthy of consideration.. 
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In the section ^'Last Rotlec t ions/* Suydam observes that what Is a 
good technique fot some teachets Is not always a good technique for others. 
As she suggests, humanistic concerns must always be an Integral factor in 
viewing the totality of teaching. How various factors* affective and 
cognitive* weave together to articulate effective teaching principles* 
generic ot specific^ is a very complex and unsettled question* Ainidst 
all these complexities, one concludes using some empirical evidence* 
th^t the logical nature of a teacher's linguistic behavior is a potent 
variable for influencing learning. 



^rspectives From Other Research 

Earliur in this paper a case was made for the necessity and desirability 
of conducting research on teaching and on teacher education In general* 
In the preceding section* an attempt was made to provide a perspective on 
how research In the Teaching Strategies Project, as eKetnpllfied by the 
remaining f>apers In this monograph, can contribute to Identifying effe- 
tlve teaching principles*. This section will discuss research on the 
teaching of mathematics and other subjects that has particular relevance 
to the work of this project. 

It is fair to say that research has found out more about what 
variables are not related to effective teaching than about what variables 
ace iri.:,ated to effective teaching* In reviewing the School Mathematics 
Study Croup's (SMSC) research on teaching ef f ectlvensss* Fey (1969) noted 
that: 

Effectiveness of teaching using the SMSG materials is not 
significantly correlated with teacher's experience^ collegiate 
courses and gradeSi or participation In professional activities* 
Most and least effective teachers were not differentiated by 
the amount of time they spent in preparation for teaching- 
There was only a weak indication that procedures in making 
assignmentSi explaining new matetial, conducting learning 
and thinking experiences relevant to previously assigned 
material, and evaluating and responding to student performance 
made a difference In the patterns of classroom behavior 
developed by effective and Ineffective teachers, <p* 55) 

What should be noted is that the variables Identified above do not 
deal with teachers' classroom behavior^ except for those measures involving 
Flnnders' instrument* (It should be noted that other research Involving 
this instrument has found certain patterns oE teacher behavior to be 
associated with achievement*) Fey <1969)t reviewing other studies In mathe- 
matics education, found that variables that describe what teachers are — 
as opposed to how they behave in the classroom — tended not to be telated 
to achievement * 
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It seems reasonable to assume that research must focus on t^.hat the 
teacher does ia the classroom* As mentioned above there has been very 
little of this kind of research in matheroattcs education* Exceptions, 
as indicated by the articles published in the first six years of The 
Journal ^or Research In Mathematics Education ^ consist primarily of 
studies on broad classifications of teaching, e*g*i discovery versus 
expository or activity versus expository or studies in which a psycholgical 
construct such as learning hierarchies was utilized in instruction* 
One might have predicted the lack of research on mathematics teaching 
behavior* Holtan Cl967) surveyed ongoing and proposed research activities 
in mathematics education* Of nearly 90 projects he identified* no more 
than ten and probably less than five could be classified as research on 
effective teaching behavior* Is there, then* some body of research relevant 
to the research in this project? There is. and some of chis research 
is discussed beloi/* 



Promising Variables From Other Research on Teaching 

Dunkin and Biddle <1974) and Rosenshine and Furst <197l) have 
provided impressive syntheses of research on teaching* Some of the 
variables in the studies they review appear to be potent — both empirically 
and intuitively — in predicting effective teaching behavior* Some of these 
variables involve affective and others co^^nitive aspects of teaching* In 
both reviews, two variables, viz*, clarity and variability, are cited that 
might have particular promise for research on teaching mathematics* 

However* these two variables are not easily defined* Dunkin and 
Biddle C1974) discuss what they call hi&h inference variables and low 
Inference variables * A high inference variable la one which is rather 
subjectively determined* That Is* its behavioral manifestations are not 
well-defined* On the other hand, a low Inference variable is one for 
which a behavorial definition is easier to obtain, e*g*, a count of the 
number of questions asked* Usually high inference variables are more 
stable in teaching behavior and are of more interest to researchers* 
Clarity and variability are considered high inference variables* 

Rosenshine and Furst (1971) cited seven investigations of the clarity 
of a teacher's presentation* Clarity was generally described in terms of 
whether the teacher^s points hrere clear and easy to understands whether the 
teacher had facility with the subject and could react to students In ati 
intelligent way, and whether the cognitive level of the teacher's lesson 
was generally regarded to be appropriate for the students* In generals 
clarity accounted for a significant part of the variance of student 
achievement* Rosenshine and Furst (1971) noted that "In those studies 
for which simple correlations were available, the significant correlations 
ranged from * 37 to * 71" (p* 4^)* Rosenshine and Furst identified other 
studies in which the variables Investigated were related to clarity and were 
significantly related to student achievement* Some of these variables 
were coherence of presentation, organization, and vagueness (negatively 
related to achievement)* But it is difficult to ascertain what behaviors 
characterize clarity or the related variables even though ratings of these 
variables were relatively stable across occasions for a particular 
teacher and class* 
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According to Turner (1971), Bellack and Davlt2 Investigated the con- 
gruence between the operation called for by a teacher*^ cue and the operation 
performed by the student. Turner noted; 

A distinctly bizarre outcome o£ the Bellack and Davltz study 
was that the type of rating reaction given by the teacher, 
classified as either positive or negative, reiaalned constant 
at about 80 percent positive Irrespective of the congruity or 
Incongruity of the responses of the pupil. Thus, If the cue 
called for a definition and the pupil opined rather than defined, 
there appears to be ^ 4/5 probability that he would be positively 
reinforced If the teacher made a rating response at all. (p. 19) 

Turner then asked how well teachers understand the logical dimensions 
of their cuing behavior. 

Is clarity of presentation related to the congruity of the logical 
aspects of classroom Interactions? Further, if this Is a viable way to 
view clarity, can moves and strategies as presently explicated be used to 
help define clarity in terms o£ low Inference variables? The teaching of 
mathematics seems to be suited to such an analysis. 

Dunkin and middle <1974) reviewed several studies by Hlller and others 
In which the notion of vagueness of a teacher^s presentation was considered.. 
Vagueness was found to be negatively associated with pupil achievement. 
Further, vagueness seemed to be specific to teachers and not to lessons. 
This finding seems to support the findings related to clarity. Also, a 
teachers' knowledge of the subject tended to reduce ttie vagueness of a 
lesson. This finding seems to be Inconsistent with the result of the 
research conducted with mathematics teachers using SMSG materials 
(Torrance & Parent, 1966). 

Generally, a teacher^s knowledge of a subject, as measured by an 
achievement cest, has not been found to be related to scudenc achievement. 
PerhapSf howeverf there is a more fruitful way of defining knowledge o£ a 
subject . Turner (1971) made che following suggestion: 

Perhaps the relevant evidence for whether a teacher "knows the 
subject^* does not lie In whether he can correctly answer che 
items on a test so much as it lies in his reactions to pupil 
responses to the cues he himself has emitted — in short* in the 
kind of performance standards he employs with respect to 
substantive responses from pupils, (p. 20) 

This leads to the consideration, then, that the logical dimension of the 
teaching act as depicted by moves developed by Henderson and others might 
eerve as a means of defining a teacher^s knowledge. Consider a mathematical 
concept.. Can a teacher Identify examples or nonexamples of the concept? 
Can necessary or sufficient conditions for objects to exemplify a concept 
be identified? Can the teacher present a counterexample given a false 
generalization by a student? Such questions could begin to provide a 
batfis for defining a teacher^s knowledge of content.. 
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A second proniislttg variable is that of variability of a teacher's 
teaching behavior* Rosenshine arifi Furst (1971)^ in reviewing research on 
teachingt considered this variable to be quite promising. As with clarity 
however, variability is a high inference variable for which low inference 
behaviors indicating variability have yet to be identified. Indeed^ 
variability has be^ defined if* many ways* ranging from the variety of 
^late^:ials used to cognitive variability in classroom discourse* Dunkin 
and Biddle (1974), in reviewing studies on logical variabilityt noted that 
Furst found that teacher^ logical variability — that is, using analytic 
and evaluative comments in contrast to largely empirical statements- 
was positively related to pupil achievement* 

Fey (1969), in reviewing the SMSG studies on teacher effectiveness* 
pointed out that the productive thlnkittg ability of teachers was a 
significant predictor of teaching effectiveness* Fey noted: 

The most effective teachers produced more ideas abo«t 
indications of success or failure in their teaching, 
causes of success or failure* and alternative ways of 
teaching course concepts* (p* 55) 

It is not clear how far the notion of productive thinking as described 
above is consistent with the notion of variability* What seems intuitively 
cl(iar, however J is that a teacher who can be flexible and insightful 
concerning factors that contribute to the effectiveness of a lesson is 
better equipped to promote learning than one who is not* Substantial 
work needs to be done to investigate relationships between Particular 
classroom situations and how teachers can react cognitively (as well as 
affectively* of course) to those situations* Agairt the question arises 
as to whether knowledge of moves attd strategies can increase a teacher*s 
variability in teaching* 

The variables of clarity and variability were Identified by Elosenshine 
and Furst (l97I) as two of the five most promising variables based on 
empirical evidence for predicting student achievement* (The remaining 
three were enthusiasm, task oriented or business like behaviors* and 
student opportunity to learn*) The two variables were chosen for review 
here» in part* because empirical evidence suggests they are related to 
achievement and^ in part^ because of their appeal to related research in 
teaching strategies* Henderson, in this monograph, points out the 
desirability of investigating variables within the domain of specific 
content 'areas* The analytic nature of mathematics may perTnlt research 
on clarity and variability with a precision not possible if* other subject 
areas* 

Several questions come to mind as a result of the above discussion* 
They have been suggested previously but are reiterated here for emphasis* 

It tf one is willing to accept that clarity and variability have 
potential for predicting success in mathematics achievement* how can this 
relationship best be investigated and established? 
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2. To what extent can moves and strategjt^s be used to define the 
cognitive variables of clarity anJ variability? 

3. Can a teacher be trained to exhibit a desired level of clarity and, 
if the answer is yes, how can this training be carried out? 



In this paper, issues on research on teachirig have been raised and 
considered from various perspectives. The goal of research concerning these 
issues is the identification of effective teaching principles. There are 
various approaches that can be used to identify such principles. Studies 
which are carefully controlled and focus on a monadic definition » such 
ns Dossey'St exemplify one such approach*. Another is the use of descriptive 
studies which explicate various aspects of the teaching act. Medley (1973) 
emphasizes the need for researchers to capture the dynamic aspects of 
teaching. A teach'-ir^s competerice is related more to when a teacher uses 
a particular technique than the mere fact that it occurs. To illustrate 
his polntt Medley (1973) made the following analogy: 

Medical research does not concern itself with whether the best 
doctors ^se penicillin more often than, say, cortisone; it 
concerns itself with what penicillin is good for, and what 
parameters or conditions determine its effects, as well as 
with what cortisone is good for and what parameters determine 
its effects., (p. 4^) 

Descriptiv^e research and tightly controlled research do not have to 
be disjoint. Descriptive work serves the role of identifying variables 
and relationships worthy of investigation.. Consider, for example, the 
teaching experiments of the Soviet researchers. Menchinskaya (1969) 
investigated the effects of varying irrelevant and relevant attributes 
in teaching mathematical concepts. Zykova (1969) observed the effect 
of various visual representations of examples and how they affect 
acquisition of mathematical concepts. These studies are primarily 
descriptive in nature, focusln.> tn highly qualitative aspects of teaching 
and learning. Findings of su. research can influence the work of highly 
controlled studies, such as those of Shumway (1974) or Dossey and Henderson 
(1974), that are relevant to research on teaching strategies. 

There is also a need to determine if and how teachers can be trained 
to utilize moved or strategies or to demonstrate some desired behavior such 
as clarity or variability. Presently, pedagogical theory on teaching 
mathematics does not consist of empirical generalizations that can be 
asserted with great confidence. This situation is not unique to knowledge 
about teaching mathematics. It does raise, however, a question concerning 
the basis on which teacher education programs can be constructed. Given 
the present state of the art, mathematics teacher education programs must 
be content with closing the gap between what is believed desirable and 
what is actually the case. 



Conclusion 
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The growing national movement to hold individuals and institutions 
accountable for their actions makes it more desirable than ever to 
investigate principles of effective teaching methoda* Teaching ia 
designed to promote learning. But learn;lng can be caused or inhibited 
by factors other than the actions of a teacher* Implicit in Etetzer'e 
paper In this monograph \s the belief that teachers should take reaponsibility 
for defining those actions for which they are willing to be accountable* 
As an analogy* Etet^er (1976) noted that in the case of phyaician^s account- 
ability^ one speaks of malpractice not malhealing* Moves and strategies are 
one area worChy of consideration in trying to define teacher accountability* 

One other observation should be made* It relates to the concern* raised 
in part by Suydamj that teaching is a very complex phenomenon involving 
a large number of variables* In short, teaching can not likely be profitably 
conceived as a unidiDaensional behavior* Fey (1969) » whom Suydam cltea* 
says it quite aptlyr 

Ti;^ question of predicting teache^' f:f fectiveneas is not simply 
answc^^red by direct measurement ol cjvious variables » but must 
be viewed as a complex interaction of several interrelated 
classes of variables* (p. 60) 

Clearly} variation in sequences of moves as presently conceived can 
not by themselves singularly and totally account for teacher effectiveness* 
Two teachers using exactly the same strategies are likely to get different 
results If affective variables differ greatly* Yet the question remains 
as to whether* on the whole, the logical nature of moves is a^ significant 
variable in viewing instruction* Surely all else being equal rapport 
is an important ingredient for effective teaching* But it is highly 
doubtful that rapport alone — or any affective variable — can account for 
achievement where extensive differences between teachers exist on cognitive 
measures* Thus, the question remains and deserves consideration: "To 
what extent can moves and strategies account for variance in effective 
teaching?'' 

Finally* the reader may have noticed that this introduction has raised 
far more questions than it has answered* Both the introduction and the 
remainder of the monograph are intended to stimulate and challenge those 
people Interested in research on teaching mathematics* If the intended 
stimulation and challenge leads to research on teaching strategies* then 
the unanswered questions will have served their purpose* 
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Teaching Sttategied: Historical and Contemporary Perspectives 

Othanel Smith 
University of South Florida 



The term "strategy'' comes from the Greek word "strategia" meaning 
generalship. It consists of a combination of two words, "stratos" mean- 
ing army and "a^tein" meaning to lead. It pertains to the art of maneuver- 
ing troops or ships^ and it is used to denote the science of nilitary 
command in conflict with an enemy. In a more general sense, the word 
'^strategy" Is used to denote a particular plan or method of reaching a 
gosl. Such a plan or method is an instance of strategy and might appro- 
priately he called a strategem^ although we shall not use the singular 
torm. 

Because of its military origin, we think of strategy in the conte^ct 
of conflict; the strategy of international politics, of a political 
campaign, of a military campaign^ of labor in its struggle with manage- 
ment. The behavior involved in planning and executing a strategy^ such 
as the strategy of a military campaign, must presuppose the position of 
the enemy, his resources, his likely moves, and so on. The best strategy 
depends upon what the enemy will do as well as his advantages and disad- 
vantages. 



Pedagogical Uses 

Some persons decry the use of the term "strategy" in pedagogy. It 
is easy to believe that naive historians a generation hence will vrlte 
of the military mentality of those of us who use such terms. 

Be that as it may, there are some useful parallels. The classroom 
involves a teacher and a number of pupils in situations where objectives 
are to be attained through the actions of the teacher* often In the face 
of such resistances as conflicting motivations and cognitive strains. 
How are such situations similar to the ones faced by a genersl? They 
both have ends to be attained and means are used to attain them. They 
are alike, also, because the teacher and the pupils do not always see 
alike, and hence the situation often exhibits differences of motivation. 
Information, and opinion. Then, too, pupils must be organized and skill* 
fully managed if goals are to be realized. Also, like the military 
situation* the parties are in no sense peers. The authority relationship 
in the teaching situation is one in which the teacher is always in a 
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position of greater influence than the pupil. But the similarities 
end here*. The teaching situation is different in at least two aspects. 
For one things the outcomes are beneficial to the pupil, and they are 
no loss to the teacher. For another thing, both teacher and pupil typi- 
cally become engaged in cooperative activities that take the pupil into 
the domain of knowledge possessed by the teacher^ 

Pedagogically , strategy refers to ^ set of actions that serves to 
attain certain results and to guard against others* From a general 
standpoint, strategies are used to induce pupils to engage in verbal 
exchange, to insure that certain points will be clarified^ to reduce 
the irrelevant or wrong responses, to cooperate in activities^ to assure 
that objectives will attained, and so on* 

Apparently "strategy" is a label for what has historically been 
called method or procedure. The gain from changing terminology is not 
so apparent. Changing the name of a horse does not enable him to win 
more faces. The question of whether we are talking about the same horse 
or a different one is not wholly clear. The terra '^strategy" is being 
used so fast and loose by so many persons that one hardly knows what 
is being referred to. We hear such expressions as the ^'strategy of 
measurement/' '^curriculum strategy," "control strategy/* and we are told 
that sequencing and pacing of learning are strategies.. All that aside» 
why abandon the word "method?" There may be no good reason* However, 
"method*' is closely identified with a priori approaches to the Improve* 
ment of teaching. When we began to look at teaching behavior as worthy 
of study in Its own right, to analyze it, and to seek ways of improving 
it as sucht we needed new words to designate what we found*. So we began 
to use such labels as strategy, moves, or tactics* The concepts designated 
by these labels are similar to the old concepts of method and techniques^ 
but they are also different. The differences and similarities can be 
readily seen in a historical context. 

Grand Strategies of the Recent Past 



Up until about three decades ago, the improvement of instruction con* 
sisted largely of attempts to impose upon teaching behavior patterns 
derived from psychological and philosophical concepts. In this century, 
there are four notable examples of this approach, all rooted in the 
Darwinian mentality. The Darwinian view is that the world is a situation 
in which living things either adapt themselves or they perish*. This 
adaptation takes place on a grand scale in which shifts in the environment 
bring about the necessity for new ways of existing^ These new ways are 
determined by variation, natural selection, and a resulting adaptation of 
the species to the new situation. 

In one way or another the patterns of teaching behavior derived 
from psychology and philosophy reflect this cosmic model of adaptation 
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ar\d survival* The maze and the puzzle box contrived by Thorndike to study 
the learning of animals were miniatures of this cosmic pattern* Deprived 
of food in the puzzle box the cat^s survival depended upon his escape* 
He did so by trial and error* The successful trials were retained, and 
the errors were stamped out* The process of learning was that of natural 
selection among rhe variations of behavior, resulting in adaptation and 
survi vai* 

To make sure, Thorndike (1965) ruled out the possibility of imitation 
by placing the cat in a position to see other cats escaping from the same 
puzzling situation* He ruled out instruction by putting the cat through 
the movements which were necessary for escape* tn neither case did the 
cat learn to escape froui the box* 

Thorndike (1909) thus concluded that the cat Learned to extricate 
itself neither by intelligence nor by instruction* This conclusion 
reflected his general position that 

In life and in mind the same cause will always produce the 
same effect, that the bodies and mind of men are a part 
of nature, that their history is as natural as the history 
of the stars, their behavior as natural as the behavior of 
an atom of hydrogen* 

To improve teaching, according to this view, is to discover the 
natural conditions of learning and to shape the teacher*s behavior to 
these conditions* Thorndike (191^) stated the natural conditions of 
learning in his three laws; the law of readiness, the law of exercise, 
and the law of effect* The law of readiness entails some conditions of 
imbalance between the organism and its environmentt for example, hunger, 
as in the case of the cat in the puzzle box* The law of exercise required 
that the learner either practice what was planned for him or, as in the 
puzzle box, engage in random activities* The law of effect entails 
dissatisfaction from failure or satisfaction from successful trials* 

This pattern was first imposed upon the teaching of reading* If the 
teacher provided the child with chances to read while in a state of 
readiness, the child would make attempts to read and by the effect of rewards 
would be encouraged to continue his efforts and thereby learn* Even 
today the concept of readiness is basic to the teaching of reading* A 
number of attempts were made to apply Thorndike's laws of learning to 
teaching in general* By and large his conception of how learning occurs 
has permeated our thinking about teaching to such an extent that we are 
often unaware that we are persuaded by his views* 

A second notable example of the imposition of a pattern upon teach- 
ing behavior is to be found in the work of Skinner (1968)* Trial and 
error left little opportunity for the experimenter deliberately to shape 
the response which the cat makes to the pu?*zle situation* It is to Skinner 





that we must attribute the insight that the cat's behavior in the 
situation could be influenced by the experimenter* One. of the ways 
in which this could be done was to reward those behaviors which vere 
in the direction of success and not to reward those that were inappto- 
prlate* The experimenter could thereby shape the behavior of the animal 
by successful approximations toward the desired pattern. Skinner thus 
refined Thorndike*s laws of exetcise and effect. He substituted for 
these laws the concept of shaping the behavior of the learner by 
successive increments In the direction of the ultimate behavior* 

This pattern of teaching was tried out through programmed instruc- 
tion which Involved Incremental learning by the influence of planned 
reinforcement. Today the primary emphasis is upon what is frequently 
referred to as behavior modification where teaching becomes a matter of 
reinforcing desired behavior and not reinforcing that which is undesired* 
Pupil behavior is thus at last f ram^* 1 in accordance with the natural 
conditions of learning, and the successful teacher is deemed to be one 
whose behavior institutes classroom circumstances in conformity with 
these conditions* 

Two other notable examples of attempts to impose a pattern upon 
teaching behavior are from the field of philosophy* These two patterns 
came also from the Darwinian orientation* The first is found in the 
works of Dewey (1910) about the beginning of this century, Dewey had 
come to the view that man's intellectual activities were a response to 
some sort of perplexing situation, Man coped with a situation by analy- 
zing it and formulating a plan for dealing with it, Dewey called this 
plan hypothesis. After its formulation the plan would be tried out, first 
in imaginative rehearsal and after that by action. If the consequences of 
the plan turned out to be a satisfactory resolution of the situation^ the 
problem was deemed to have been solved* 

The parallel between Thorndike and Dewey's thought is fairly evident* 
Instead of the situation inducing a state of readiness^ as in the case 
of hunger^ Dewey substituted the notion of a perplexing situation in 
which a felt need emerges. For the notion of trial and error » Dewey sub- 
stituted the Idea of a hypothesis or plan of action tested in prell-- 
minary fashion by mental rehearsal of consequences rather than by overt 
trials. If the hypothesis survived the rehearsal, it could then be tested 
in action* Like Thorndike, Dewey's general notion was that of continuity 
in nature* He held that lower forms of life, even one-celled forms of 
existence, reflected In their behavior the pattern of inquiry in man him- 
self, 

UTitness here again the view of man as adaptable. But in Dewey's view» 
man adapts himself through the use of intelligence rather than through 
sheer trial and error. 

In his Democracy and Education Dewey (1916) elaborated his theory of 
how man thinks into a pedagogical method often referred to as the inquiry 
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method of Ceaching. It remained for KllpatrlcJt (1925), a few years 
later* to formulate Dewey's notions into a generalized method which 
he called the broader method, more popularly known as the project method* 
This method of teaching consisted of four elements: purposing* planning, 
executing, evaluating. In Rilpattick*s view» pupils are In a situation 
that induces purposing. Once they have decided upon their purposes, 
th^y plan, that is^ they decide how these purposes eaiv be realized. 
When their plans have been fonniilated> they then carry them out* At 
the end'of their work they turn around and look at what they have done 
and evaluate it . 

It is easy to see from this general pattern of pupil activity that 
the work of the teacher consists more In helping pupils purpose^ plan, 
execute^ and evaluate their work than in imparting information to them. 
To be sure, the teacher is to be helpful and to supply information at 
points where pupils ask for it, or where the teacher thinks it desirable. 
But giving information Is to be handled stringently lest the pupils lose 
their momentum as autonomous learners* 

It is important to note that the Idea of a situational base for 
learning, found in Thorndike > Dewey* and Kilpatric(t> and only to a lesser 
extent in Skinner's work, has not only permeated our common sense but has 
also led to a theory of learning outcomes (Kilpatrlck, 1925). In a 
situation there are many stimuli. Among them are primary stimuli which 
induce behavior resulting in outcomes identified with the knowledge being 
studied* There are many other stimuli in the situation that evoke 
behavior unrelated to the main or primary outcomes of study. This 
behavior leads to attitudes or affective learnings. 

Kilpatrick (1925) made a great deal of this point. It became the 
basis of his concept of concomitant learnings* These learnings are 
those which occur along with primary learnings or the cognitive outcomes 
associated with the discipline under study. For example, at the time 
that a pupil Is acquiring the learnings of history or science^ he is 
also learning to like or to dislike the teacher* to like or dislike the 
subject, to like or dislike school, and so on. These concomitant learn- 
ings have been rediscovered and referred to nowadays as unplanned out" 
comes. They are central features of Kilpatrlck's conception of the 
broader method of teaching set forth fifty years ago. 

A second notable example is the Horrisonian (1926) theory of teaching. 
Morrison, too, worked in the shadow of Darwin. To him learning was also 
a way of adjusting to the world. The knowledge that man has accumulated 
and the moral notions he uses to guide his conduct are forms of adaptation 
which have enabled man to survive in the world as it is. As Morrison 
(1934) put it; 



ERLC 



35 



-28- 



So long as education is necessarily a matter of adjustment 
by process of adaptation and so long as the object of 
adjustment is a world which is common to all mankind, it 
follows that it must be possible to construct a curricultjm 
which is objectively valid* (p*. 49) 

The objectives which constitute the curriculum aCe always either attitudes 

or acquired abilities* He divides attitudes into two categories: attitudes of 

understanding and attitudes of appreciation* Attitudes of understanding 

are to be found primarily in the sciences and attitudes of appreciation 

primarily in the arts* Abilities are found In the uses of language^ in 

bodily activities^ and so on.. To attain these objectives is to acquire 

a personality adaptation.. Once a personality adaptation has occurred it 

is never lost* In Morrison's view when the learner had mastered an 

ability or an attitude of understanding or an attitude of appreciation, 

be never forgets or loses it* This notion is fundamental to bis 

mastery formula for teaching* 

It is interesting to note that Morrison distinguishes between per- 
formance and learning outcomes and experience and learning outcomes.. His 
view is that one does not leam an experience but that he learns from 
experience. In short, learning is not behavior but an adaptation of 
personality* This adaptation controls subsequent behavior.. He dimply 
took the Darwinian notion of adaptation to an environment as tbe basis 
of survival and translated It into an adaptation of personality as the out- 
come of a learning cycle.. 

The pattern of teaching behavior corresponding to the cycle of learn- 
ing is what he refers to as systematics teaching or his mastery formula.. 
The mastery formula is: pretest, teacb» test, diagnose* and teach again.. 
Repeat to the point of mastery* 

These four conceptions have dominated attempts to improve teaching 
throughout this century* From time to time they have faded away only 
to reappear under new names.. The theory of the project method is enjoying 
a recrudescence under the nane of. the open classroom, and the Morrlsonian 
theory is coming to the front again under the stimulation of the concept 
of mastery put forth by Bloom* 

These theories are grand strategies if strategy is defined as a plan 
for coping with any affair* Each in Its own way is a formula for coping 
with the problems of teaching regardless of both content and pupils* The 
appeal of these strategies is almost overwhelming.. They embrace a consi- 
derable measure of truth and their effectiveness with certain pupils can 
hardly be doubted, but as universal strategies they are not easily defended^ 
Yet, they intoxicate the pedagogical mind, create doctrinal disputes, and 
lead repeatedly to schisms in the teaching profession.. 
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Empirically Based Strategies 



About 25 years ago, a few researchers becarne disenchanted with the 
grand strategliss of the masters. They began to look at teaching as a 
form of behavior to be studied in Its own right. 

Teaching* like all the professions, has Its origin In the practices 
of primitive man. It Is found let man's first efforts to pass on his 
knowledge and abilities to the young just as the work of the physician 
Is foreshadowed In the primitive medicine man's care of the afflicted. 
Primitive crafts that ultimately become professions develop through the 
accretion of knowledge and skill. To understand a craft Is to possess 
the prime conditions for Its development. Exploracion of the phenomenon 
of teaching is now In its early stages. This late start is attributable 
partly to the fact that all along we assumed that If we understood the 
phenomenon of learning, we would thereby know how to teach; and partly to 
the fact that we were taken captive by the belief that teaching could be 
derived from the philosophic and psychological disciplines. As a result* 
the study of teaching in Its own tight received but little attention prior 
to the 1950*3. 

About this time teaching began to be perceived as a form of social 
behavior having its own forms, Irregularities, and problems. In addition, 
teaching takes place under relatively constant conditions, namely, time 
limits, authority figure, student ability. Institutional structures* and 
social expectations. Given these perceptions » naturally the development 
of a rational plan for the improvement of teaching would begin with an 
understanding of teaching behavior Itself. 

It Is also evident that to apply any theory one must understand the. 
phenomenon to which It Is to be applied. It Is just as necessary for one 
to understand what teaching Is as It Is for him to understand the concepts 
and principles which he applies to Improve It. The turn about In efforts 
to improve teaching behavior Is due In part to the belief that one must 
first understand the dimensions of such behavior before he can think 
realistically about its control through the application of principles. 

During the last three decades* scores of studies have been made In 
an attempt to determine the dimensions of teaching and In a few cases to 
relate these dimensions to pupil schlevement. These studies fall roughly 
Into two categories: those which use a checklist or rating scale and those 
which rely upon recording Instruments for data. 

There are two notable cases among those who used Inventories and 
also related dimensions of teaching to achievement of pupils. Ryans 
(I960) in his study correlated categories of teaching behavior to pupil 
achievement. He found that those teachers who were systematic and 
businesslike were more successful In Inducing achievement than teachers 
who were unsystematic and rambling. The second example Is the Flander's 
(1970) study. This research shows that teachers who make use of pupil 
ideas and who accept the pupil's feelings and encourage them have higher 
achievement among their pupils than teachers who are more directive. 
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These studies cell us the good and bad practices that occur normally 
in classroom situations. This information enables us to emphasise the 
effective practices and to eliminate those less successful > These studies 
thus enable us to refine conventional teaching behavior by eliminating 
ineffectual aspects of it. They do not impose upon teaching behavior a 
new pattern, but instead these studies maintain the old pattern and refine 
it to make It more conducive to pupil achievement. 

There have been a number of attempts^ some of them successful^ to 
show the relationship between the dimensions of teaching* determined by 
analysis of tape recordings, and the achievement of pupils. However, the 
emphasis has been upon describing teaching behavior as such rather than to 
define It into more effective patterns of behavior. 

Both approaches to the study of teaching have revealed a number of 
variables related in more or less degree^ to student achievement. Among 
these variables are clarity^ variability of activities and levels of 
loarningt task-oriented or business-like behavior^ uses of student ideas 
and general indirectness of teacher behavior^ uses of structuring comments 
and types of questions (Rosenshine S Furst» 1971). These are modest 
achievements^ but they indicate that this approach to the improvement of 
instruction is viable and give ample justification for continuing it with 
hope and enthusiasm. 

Some of these studies (e.g.j Flanders^ 1970; Ryans, 1960) retain one 
feature of the grand strategies^ They assume, as do the grand strategies^ 
that all of the different kinds of learnings are to be taught by the same 
strategy; that is to say, strategies which apply to the teaching of con- 
cepts apply also to the teaching of rules^ cause'-ef feet relationship^ 
appreciations, morals, and psychomotor skills as well as to all disciplines. 

My ovn studies have led me to the view that teaching behavior varies 
with the discipline and the nature of the learning product* However^ like 
Thorndike and others^ we began with the notion that patterns of behavior 
could be imposed upon teaching. This is manifested in our early belief 
that certain logical operations could be imposed upon teaching behavior; 
that if this were done the critical thinking of pupils would be enhanced. 
Professor Henderson (1953) and 1» being of the same persuasion^ collaborated 
with some high school teachers In a project to determine whether or not 
critical thinking could be improved by teaching the logic of the discip- 
lines along with their content. 

As our work progressed it became evident that the logical operations 
we were asking teachers to perform did not fit into their patterns of 
behavior. Yet from cursory classroom observations^ it seemed to be evident 
that some logical operations were in the teachers* performance. They 
did define terms» explain events, and describe phenomena. 

This apparent congruity between teacher performance and the opera-* 
tions we were attempting to impose upon teaching led me to undertake a 
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sequel to the critical-thinking study. Our first task was to tapfi 
record the discourse of teachets and pupils and to analyze It Into 
categories of logic. 

We found that teachets did In fact perform a n'jmber of logical 
operations with thelt pupils.. They defined, designated, classified, 
compared and contrasted, explained^ evaluated, opined and Inferred 
conditionally (Smith i^Ieux, 1970)- They did these very loosely and 
imperfectly, typically engaging In only a part of an operation. But 
even mote Important^ these operations were not performed as ends In 
themselves but as elements in a larger pattern of behavior. This fact 
seemed to account partly for their Incompleteness and the resistance 
of teachers to the performance of logical operations as they taught their 
disciplines > 

We then conducted a further analysis of the classroom discourse 
to Identify the maneuvers within which logical operations are embedded 
(Smith, Meuxt Coombs, lJuthall, & Pteclane, 1967). After trying a number of 
approaches, we finally broke the discourse Into units called ventures- 
We uaed as a criterion of a venture that the discourse leads to a mean- 
ingful object, that It have Import- We thus classified the ventures In 
accordance with the meaningful objects embedded in them- This proce- 
dure resulted In a ntunber of different types of ventures: concept 
ventures, appreciation ventures, cause-effect ventures, reason ventures, 
value ventures, rules ventures, procedural ventures^ and particular 
ot factual ventures- These varied In length from a few lines to several 
pages. Professor Henderson has referred to the objects embedded In 
these ventures as ''teachable objects,'* and we shall use rhar term here- 
in the course of reaching these objects, teachers and pupils ver- 
bally manipulate the content of instruction. We called these ''manipu- 
lations moves.*' Consider a:v example froTn a causal venture- There are 
three cla^^es of moves: those which describe causes, those that describe 
effects, and those which relate the two*. An example that relates cause 
to effect Is taken from e social studies class. It is a chaining move. 
Such a move links a cause to an effect by describing conditions leading 
to the effect. The following move links the discovery of gold In Alaska 
to Increased prosperity ±n the United Stspssi 

Fupll: The value of the gold means that the prices of corn 
and wheat go up- 

Teacher; All right. The fall In the values there affected 
prices so the farmer proflts- 

The fall In the value of gold is noted as a consequence of the discovery 
of gold (the cause).. This consequence^ in turn. Is noted as causing 
an lr,crease In the price of farm products. This price increase Is part 
of what Is meant by prosperity. In chis move there Is a complete chain^ 
though poorly described.. 
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We identified the moves involved in each type of venture. The 
character of the moves varies with the kiJid of venture. The moves in 
a causal venture are quite different from those in a concept venture 
or in an appreciation venture* When a number of ventures of the game 
type are analysed across disciplines* It turns out that each type 
h^s more than one pattern of moves depending upon the discipline. These 
patterns constitute the large maneuvers which we refer to as strategy, 
and the moves they contain represent elements of logical operations* 
In our viewt therefore* one does not speak of ^ strategy of teaching in 
general but of strategies appropriate to each teachable object in each 
discipline. 

Empirical studies of teaching have led us to conclude that there 
are two types of strategies* One type is content bound* The strategy 
for teaching concepts* for example* is not the same as the strategy 
for teaching cause-effect relationships or rulfts or for that matter any 
other of the teachable objects. The strategy varies also with the dis- 
cipline. The second type of strategy is content free* Flanders ' (L970) accep- 
tance behavior is an example of this type. Put in general terms, it Is 
a strategy of Ingratiating and involving the student by accepting his 
feelings and using his responses in a constructive and acceptable manner. 
This kind of strategy, being content free. Is compatible with the grand 
strategies uf the niasters. General strategies, such as that of Flanders, 
are for interacting with pupils. The content bound strategies are for 
Interacting with the content of Instruction. Both strategies are essen- 
tial If* the teaching process. We hypothesise that an Improvement in the 
performance of either one will influence the outcome ^>f classroom activi- 
ties. 



Summary 

What have we learned from the last 23 years of research on teaching, 
and what difficult matterfj have not been touched upon? We summarize 
these as follows: 

1. We are beginning to sec how the performance of the teacher 
is dependent upon the form of knowledge and the discipline he 
teacJies. Some authorities have insisted from time to time that 
methods of Instruction should be related to the content of Instruc- 
tion. This relationship WhIS explored briefly by Thorndike and others 
during the flrsL q^.jarter of the century, but only now are we beginning 
to see that laws, concepts, and procedures, for example* are taught 
in quite different ways. Recent research lias also emphasized the 
cognitive difference among disciplines. For example, empirical 
sciences contain laws, concepts* and procedures as forms of knowledge. 
Mathematics contains no laws; history lias law-like statements but 
no laws and no procedures. 
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2, We are begianing cc recognize Cbac out oldet concepcions 
of method did not include tixe distinction between the interaction 
of the teachet with the content and his intetactlon with pupils. 
This distinction poses questions of major import. For example, 
how can rigorous handling of concepts, principles, procedures, 
and the like be maintained without turning off the pupils? 

Can it be done by improving the ingratiating techniques while 
more and more rigor is built into content strategies? Or can 
rigor and depth of insight resulting therefrom induce their own 
mot ivation? 

3. Research has already uncovered certain variables — some 
related to content, e,g,, clarity, and some related to the pupil, 
e,g, , acceptance of pupil responses — which are related to achieve-^ 
ment. These strengthen expectations that further progress is 
likely. 

A, Teachir\g behavior has been anaLy/^ed into many kinds, 
Tuost oE vhich can be redticed to a few basic categories*. This 
opens up tiie possibility for fruitful research in both the 
cognitive and affective aspects oE teaching betiavior. 

Nevertheless, it must be noted that two basic aspects of teaching continue 
to be ignored by ail of these studies; the diagnostic-remedial and the 
preventative dimensions of teaching behavior. No matter how well the 
various moves are performed and the strategies executed, no matter how 
skillful the teacher is in the techniques of ingratiation, some pupils 
will not learn, Except in reading and arithmetic, we h^ve yet to study 
how teachers detect the learning difficulties of pupils and by what 
tnovesi they attempt to cope with these problems. It seems reasonable to 
suppose that experienced teachers of science, social studies, literature, 
and so on, have learned or recognize some of the difficulties their 
ptjpils have in learning, and they have found a number of moves that help 
pupils overcome them. Information about what teachers already know and 
do would likely open up a number of fruitful lines of research. 

Moreover^ we know that sOTQe experieiiced teachers already know how 
to prevent certain difficulties in learning and in classroom conduct* 
tkit our knowle^dge of this aspect of teaching is meager. Some research 
in preventive pedagogy has been conducted, notably the studies of Kounin 
U970> in classroom discipline and management. He has shown from analysis 
of classroom behavior that teachers who behave in certain ways^ e,g*, 
make smooth transitions from one activity to another, have fewer instances 
of disruptive behavior than teachers who do not do so. Work on preventa- 
tive pedagogy is in its infancy, and further research could be fruitful. 
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Toward the Development of 
Pedagogical Theory in Machemacicg 



Kenneth B.. Henderson 
Professor Emerlcus 
University of Illinois — Urbana*Champaign 



This paper is based on cwo assumpcions chat I vfouLd like to make 
explicit at the outset. One is that it is possible to develop pedagogi- 
cal theory in mathemacics. I state this expllcltlyj for there are some 
individuals concerned ulth macheniatics education who seem to doubt chat 
this is possible. They appear to believe chat teaching is a skill which, 
though complex, is learned by performing the act. The model is the 
apprenticeship one.. The teacher- trainee serves as an apprentice to a 
master teacher who demonstrates effective teaching and serves as a model* 
When the teacher-^trainee teacheSj he is observed by the master teacher 
who offers suggestions for improvement. But^ there is no structure to 
the suggestions, no theoretical basis, and only a meager rationale. 

Only a feu years ago at a conference on research in mathematics 
education Robert Davis (1967a) expressed doubts about the possibility 
of developing pedagogical theory In mathematics*. To Davis^ teaching is 
a skill or an art not amenable to description, analysis, and generaliza- 
tion. 

It is well known that many members of departments of mathematics 
not only doubt that there is pedagogical theory iti mathematics, but also 
doubt that it is possible to develop such theory. In contradiction to 
this theoretical position, I prefer to hypothesise that it is possible to 
develop this kind of theory. 

A second assumption is that efforts to the end of developing such 
theory are worthwhile and deserve to be encouraged*. To justify this 
assumption, I turn to the contributions of a theory— any theory—that 
disposes individuals interested in development of theory to devote their 
intellect, time, and efforts to this end* 



Contributions of ^ Theory 

The most obvious and dramatic contribution of a theory is that it 
enables those who understand it to adjust their behavior so as to obtain. 
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In so far as possible, what they want. Sound pedagogictii theory enables 
a teacher to predict what will occur under certain given conditions. The 
teacher then has some control over the situation; he does not have to 
operate only on trial and error* Theory is particularly useful when a 
teacher faces a problem he has not faced before, and his old behavior 
patterns cannot cope with it. 

I am reminded of a story by William Everitt » former dean of the 
College of Engineering of the University of Illinois. Dean Everitt said 
that an engineer is an individual, who can tell before a truck crosses 
a bridge whether the bridge will collapse. After the truck has crossed, 
any damn fool can tell. Because of his kncnjledge of theory^ the engineer 
can predict with confidence. Then he can advise the truck driver whether 
to cross the bridge and the road commissioners what weight restrictions 
to set* 

A second contribution of a theory is its explanatory power. A charac- 
teristic of ojan is his intellectual curiosity; once aware of certain states 
of affairs, he wants to know why they are as they are. Why can individuals 
who do not understand a particular algorirhruj e.g., the long division al- 
gorithmj still employ it and get correct answers? (They comprehend It 
in the sense that they know what to do but do not understand why it 'Vorks.*') 
An explanation of this phenomenon would consist of supplying facts and/or 
generali:cations derived from psychological theory from which the phenom- 
enon can be inferred; in other wordsj to subsume the phenomenon tinder one 
or more gonerailaations in psychological theory* Once this is done^ we 
feel we understand; we know why Individuals who do not understand a parti-* 
cular algorithm can still use it and get correct answers. 

Wow every theory^ sound or unsound, enables eKplaaatlon. What dis- 
tinguishes sound from unsound e::planaeion of phenomena is that the reasons 
proffered are known to be true, are not ad hoc , i.e., they explain pheno-» 
menji other than the one being considered and are not tautologies* Sound 
theory promotes confidence in one^s ability to cope with situations he 
experiences , 

A third contribution of a theory is its use In generating research- 
able hypotheses, ye know that some mathematics teachers who, on occasions 
teach by Inductive discovery find that some students do noT_ make the dis- 
covery at all and others verbalise one for which there are countereKaniples . 
Why do Such students not arrive at the correct conclusion which usually is 
a generalissarion? Perhaps because the teachers in choosing Instances do 
not sample adequately from the domain over which the generalization to be 
discovered holds. Perhaps because they do not sequence the instances so 
as to facilitate the abstraction of the pattern. These are hypothetical 
explanations, i.e., they conflict with no principles In the theory^ but 
we do not know whether they are true. We now hypothesize that if the 
teachers were taught to sample adequately and how to sequence Instances to 
make the apprehension of a pattern-»*-stmilarities amidst differences-- 
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easy, and are given the rationale for doing these things, fewer students 
would experience the difficulties identified- This hypothesis is amenable 
to testing by experimentation. Whatever the outcome* we have a proposi- 
tion to a<ld to pedagogical theory, A good theory enhances its own advance- 
men t , 

You will note that I have chosen to defend a theory oi> utilitarian 
grounds, 1 did this because in our society such an atgument is persuasive* 
But I would not t:are to maintain that the utilitari^in aspect ot a theory 
is the only ground fot accepting it* To some, a contribution of a theory 
is the organisation it provides of the knowledge of the field over which 
the theory holds. People who value order, the portrayal of relationships^ 
and deductive power as ends in theniselves find satistaction in the study 
of theory and in its development. 

You may remember that L began with an identification of two assump- 
tions on which this paper is based, I now state what I believe to be ^ 
fact. It is that there now exists pedagogical theory pertaining to mathe- 
m^t-LCS, Let us turn to how this theory has been developed in the past and 
then to an analysis of the theory. 



Approaches to the Developntenc 
of Pedagogj-cal Theory 

One approach to the development of pedagogical theory has been for 
various teacihcrs to reflect on their own experience and extract from it 
suggestions for how to do something. Thus, in mathen^atics education we 
see articles in professional journals and sections in textbooks on methods 
on how to teach th^it the product of two negative numbers is a positive 
number, how to show that the empty set is a subset of every set^ how to 
teach students to prove theorems in geometry, how to teach the solution 
of equatlonsi and how to teach students to solve worded problems, atnong 
other "how-co-do-its." 

The suggestions distilled from experience can be at a higher order 
of generality, that is, they hold over a more extensive domain. For 



examp Lei 


Consider the following; 




I. 


Make your assignments definite and clear. 




2. 


Provide motivation. 




3, 


Distribute your questions among the students 


in your class 


4, When teaching by guided discovery* make the 
their conjectures; don't provide them extraneous cues 
gestures, or facial expressions. 


students te^^t 
by voice, 
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Usually, a rationale for the prescrlpt:ions can be given. This may be a 
deductive atgument based on propositions believed to be true, or it may 
be by supplying evidence that following the prescriptions will attain 
some desirable end, 

I do not contend that this approach has no merit.. It is the case 
that mathematics teachers value how-to-do^it atticles and speeches. These 
are practical and not couched in language teplete with fu7.zy pedagogical 
concepts. Yet I do not see this approach leading to substantial theory 
in mathematics education. Generalizing from personal experience leads to 
propositions that are Idiosyncratic rather than nomothetic. The set of 
prescriptions emanating from this approach are unsystematic and lack, 
structure. The prescriptions have restricted generality and hence 
restricted explanatory power* Moreover, they generally are not productive 
of researchable hypotheses which advance the theory. The approach tends 
not to be discriminating because it usually is not based on much analysis, 

A second approach to the development of pedagogical theory is tegatded 
as more scientific and valid. It presumes that there are implications fot 
teaching from more bAsic theories, e,g,, learning theory, social psychology, 
sociology, logic^ or communication theory. For example, from learning 
theory, we presume that we should be able to deduce presctiptions directing 
how we should teach*. 

There are, ot should be^ misgivings associated with inferring peda- 
gogical principles from more basic theories, e,g,, learning theory. One 
misgiving stems from the evidence on which the principles are gtounded. 
Typically, principles of learning are asserted whose variables seem to be 
universally quantified — all learners, all learnable objects, all situations*. 
When one assesses the experimental evidence purporting to substantiate 
these propositions, he is beset with the feeling that such extrapolation 
is not warrantt^d. Much of vhac ve know about learning has come ftom the 
laboratory r^ither than from the classroom. Many of the propositions in 
learning theories are best suppotted by evidence on how nonhuman animals 
learn, e,g, , rats, cats, dogs, and monkeys. These cannot be influenced 
by language as humans can* yet language is the chief tesource of the 
mathematics teacher. When 1 read some of the unrestricted prescriptions 
about how to teach that are ptesumably based on leatning theory, 1 think 
of the statement by the oiti cracker^barrel phllosophet. Josh BillingSt 
"It's better to know nothing thar to know what ain't so/' 

The second misgiving rests on pragmatic grounds*. It may well be that 
this approach enables us to explain some pedagogical phenomena » and this 
is better than nothing. But it Is not distinguished by its ability to 
yield confirmed predictions, and this Is what the ptactitioner expects of 
a theory, A teacher frustrated by the disparity between vhat educational 
psychology is alleged to be able to do and what^ in fact, it can do^ 
characterized aj> educational psychologist as a person who, given the facts 
in a pedagogical context, can predict what vill happen, and then when 
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his predictions do not eventuate can explain why they did not* 

Even some educational psychologists have misgivings. Bugelskl (1964) 
in his book. The Psychology of Learning and Educational Fractlce t says 
the folloulng: 

The educational enterprise is a vast and complex one* 
involving as It does the training of people from 
kindergarten through graduate and professional schools 
In a wide variety of skills and knowledge. To apply the 
psychology of learning in its present state to such a 
tremendous field of activity should give even the 
boldest psychologist some pause. (p^ 14) 

Ernest Hllgard (cited in Bugelski^ 196^) says "There are no laws of learning 
that can be taught ulth confidence*' <p* li) - Kenueth Spence (cited in 
Bugelsklt 196^), also a psychologist » echoes Bugelski's doubts* 

No definite answer, of course* can be given at the present 
time* for as yet none of them (i^e.t learning theories) 
is sufficiently abstract or complete to account even for 
all the laboratory findings. (p. 15) 

There are evidently grounds for Bugelski's assertion* "The teacher might 
well be wary of anyone who suggests some change on the basis of his 
knowledge of Learning psychology*' (p. 15) . 



Instead of attempting to derive pedagogical theory from learning 
theory, one might study teaching as a phenomenon per se * The observations 
and records* e.g., audio- and videotapes* can be analyzed either in terms 
of the kind of students or the kind of subject matter taught or the Inter- 
action of these. Pedagogical models can be developed that describe how 
the teacher teaches. These then can be tested experimentally to see how 
well they ejcplaln and predict. Under this approach^ pedagogy would emanci* 
pate Itself from psychology. Incidentally, it was this very approach that 
enabled psychology to emancipate Itself from philosophy. 

Observations are always screened through a network, of concepts and 
values* If mathematics teachers are observed — desirably in a classroom 
situntion since most mathematics is taught In this manner — without certain 
concepts and values to guide the observations » the observer does not take 
certain things Into account. Supplying fruitful concepts Is a contribution 
of basic theories such as those mentioned above* The records of the 
observations can be analyzed in terms of kinds of students or kinds of 
teachable objects^ e. g. » concepts^ facts^ principles^ skills^ and values^ 
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or the interaction of these* Drawing on whatever basic theory seems 
relevcint and fruitful, petJagogical models can be developed that describe 
how the mathematics teachers teach the various teachable objects* These, 
then^ can be tested experimentally to see how well they explain why teachers 
teach as they do and predict how well students learn* 

As some of you may know, this is the approach 1 and some of my graduate 
students have used* I have taken the position that the set of teachable 
objects, e*g*, knowledge and beliefs, is not identical to the set of 
learnable objects* Nor is either a subset of the other* There are some 
items of knowledge that <^an be taught to but not learned by a particular 
group of students* And there some objects that are learned but not 
taught, e*g*, mathematical intuition and values that we characterise as 
being caught rather than taught* Basic to this point of view is the belief 
that it is not fruitful for either clear thinking or research to define 
teaching in terms of learning- 

Which basic Theories should be used to analyze the observations? The 
answer to this question depends partly on what the theoretician thinks is 
important and fruitful, and what he is willing to sacrifice. As I conti- 
nue the analysis, you will be able to tell which theories I consider 
fruitful and which appear to get short-changed* 

1 doubt that it is profitable in the existing state of our theory 
to consider teaching in the abstract* The tendency to do so results in 
unrestrii^ted generalisiations or prescriptions* Practioners become aware 
of so many counterexamples they lose confidence in the theory, 1 believe 
that at present we should take as our object of a study a teacher teaching 
some kind of teachable object to one or more persons. For example^ the 
mathematics teacher teaching various kinds of knowledge and beliefs about 
mathematics to his students* To me» this makes theory of knowledge 
relevcint* There are different kinds of knowledge and different kinds 
of beliefs* There is knowledge that such is the case* And there is 
knowledge of how to do something. Although these are relatedi they are 
distinct* Neither is a sufficient condition for the other* Of knowledge 
of what is the case^ some of it is empirical and some is analytic. In 
elementary school and junior high school* mathematics is caught as 
Chough it Is empirical. As the student matures mathematically* hopefully 
it is taught as it really is, i,e,, analytic knowledge. 

We hflve different rules for assigning the truth-value "true'^ to these 
two different kinds of knowledge. Within each of these kinds of knowledge^ 
there arc concepts, singular statements* generalisations* and prescrip- 
tions. I would argue that the logic of each of these subsets is distinc- 
tive. And ihe d I atinc t Ivti ^ogic h^is implications for teaching provided 
the teacher seeks to show the students how we know or accept the "arious 
items of knowledge. 
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Knowledge of how co do somechiag can be classified In cerms of 
whecht^r it is b^ised on empirical gen^ralisaclons or an analytic generali- 
sations. How to use a microraeter is based on empirical knowledge of the 
relation between one tarn of the thimble and the resulting change in the 
graduations exposed on the barrel, what happens if the spindle is not 
tightened enough or tightened too much, and of the function of the ratchet. 
It is also based an knowledge of which objects are amenable to being 
measured by the micrometer and which are not. Knowing how to factor a 
polynomial over some set, e,g,, the integers, is based on analytic 
knowledge^ viz,, the distributive principle of multiplication over addition. 

There are different kinds of beliefs, e,g,, about what inathematicai 
knowledge and proficiency are necessary for certain jobs, about what ought 
to be done in solving a problem, about what is Important in mathematics, 
and about the nature of mathematics. Like items of mathematical knowledge, 
beliefs about mathematics are teachable objects. 

One can hypothesize that the kind of teachable object should make a 
difference in teaching just as che kind of behavior of the student should. 
For example, definitions have an arbitrariness associated with them that 
is not associated with generalisations. Saying that a definition is true 
or saying that it is false is not the same as making analogous statements 
about a factual statement. Surely a mathematics teacher should draw a 
distinction between a factual statement and a value judgment and hence 
teach them differently. 

Since much of the teaching of mathematics Is via language, semantics 
seems relevant and productive of insights. Logic seems relevant because 
usually the mathematics teacher appeals to the rational aspect of the 
student's personality. Logical connectors like because* therefore , if -^ then , 
and > o£, and their cognates abound in classroom dialogues. 



In our analyses of classroom dialogues, we find teachers and students 
using language to define, describe, compare* contrast, instantiate* charac- 
terize > identify, nssert , generalize, imply , infer, justify, direct, exhort, 
classify, exemplify* and others, {Someone who is familiar with John Austin's 
semantics will recognize these as illocutionary acts which also have per- 
locutionaty potential,) We have made use of the concepts of a move and 
a strategy, A move Is a bit of discourse in which language is used in a 
certain way such as those listed above, A strategy is a sequence of moves. 

Our approach has beeii to audiotape classroom teaching and then analyze 
the transcriptions utilizing the theories mentioned above to identify the 
teaching of various objects, e,g,, concepts, principles^ and skills. Then 
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each of these kinds of teaching is further an^iy^ed in an attempt to 
identify moves (bits of monologue or dialogue) and strategies (sequences 
of the moves) which ^re evident* This part of the research is naturalistic* 
conceptual, and descriptive. But it is ba/ic to subsequent experimentation 
leading to principles of teaching, 

1 shall not say much at this time about the moves and strategies in 
teaching a concept* T have written about this in a chapter in the 
Thirty^third Yt^arbook of the National Council of Teachers of Mathematics 
(Henderson, 1970)* and* more recently* in a textbook on methods of teaching 
secondary school mathematics (Cooney, Davis, & Henderson^ 1975)* In 
both of these I offered a classification of moves, a simpler classification 
in the methods book than in the chapter in the Yearbook, In both I proposed 
a classification of concepts since it appears that the kind of concept 
taugtitj to some extent* determines the moves that can be used* For example* 
there are some concepts for which some moves are logically impossible. It 
is logically impossible to teach a nondenotat ive concept — by nondenotatlve 
concept I mean one like even number greater than two or the greatest upper 
bound of the integers — by giving examples* It is logically impossible to 
give a definition of any undefined term in mathematics. And, one cannot 
give a coimterejcampie unless a false generalisation has been asserted. 

In the methods textbook there are chapters on the teaching of prin- 
ciples in which a classification of principles Is offered and moves and 
strategies identified. In passing, I might mention that by using the 
concept of move and strategy It is possible to sharpen the distinction 
between expository teaching and guided discovery* and between deductive 
guided discovery and inductive guided discovery* 

Once moves and strategies have been identified, it now becomes 
possible to ascertain under what conditions various strategies are corre- 
lated with learning on the part of students. One can hypothesize that 
certain strategies will be effective for slow learners* If one wants to 
conceive of levels of learning like those in the Taxonomy of Educational 
Objectives by Bloom (1956)* he can hypotheyise that certain strategies 
will correlate with certain levels of learning, I would venture a guess 
that for certa In kinds of concepts* e *g, * precise vs . vague, complex vs , 
stmplei abstract vs* concrete^ disjunctive vs* conjunctive, certain 
strategies wiLl be more effective than others. An analogous conjecture 
can be made about kinds of principles* e.g, ^ complex vs* simple, prescrip- 
tions vs , KS"'ii'^ilLs;i;ions* One can also conjecture that among all the 
strategies some will prove more efficient than others* that is, some will 
produce the same level of comprehension in fewer moves. For example^ I 
doubt that inductive guided discovery is an efficient strategy for teaching 
a complex principle, eg, i a generalization conditional in a form in which 
severaJ conditions are conjoined in the hypothesis. Hence, the approach 
of observing teachers teaching certain teachable objects to certain groups 
of students^ analysing the teaching* and developing models is productive 
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of resecirchable hypotheses that are capable of empirical verification, 
Dossey U972>t Malo (197^)* Rector (1966), Retzer (1967), Rollins (1966), 
Bnd others have tested some of these, 

I would feel more comfortable defending the approach to developing 
pedagogical theory in mathematics that I have just been talking about 
than the particular models that some of us have determined by using this 
approach^. Any time one uses analysis* of necessity, he focuses on certain 
factors and chooses to neglect others. It may well be that other theore- 
ticians who would make use of the approach I have suggested would come up 
with models that are more fruitful than those we have determined. Be that 
as it may» it is apparent that the specific pedagogical models I have 
described have been developed independently of learning. To anyone who 
understands theory cons truct ion» it is obvious that there cannot be an 
analytic connection, viz,, by definition, between teaching and learning. 
It must be a contingent connection, e,g,, if a teacher makes such and 
such moves, there is or is not, as a matter of fact* a correlation with 
learning on the part of the students he is teaching. The models we have 
developed enable such a contingent connection. 

Possible Additional Research 



So far, our research has concentrated on ventures in which just one 
concept, principle, or skill has been taught. Yet we know that in 
actual classroom situations usually a sequence of items of knowledge 
or belief is taught. The teaching of a concept may be embedded in the 
teaching of a principle; or a principle may be tai*tghx^>^ce a concept 
whose grasp Is necessary for comprehension of the prlncip3?e has be'^.n 
taught; or the teaching of a principle may be embedded in the teaching 
of a skill, 

Pavelka (1974), using the approach I have described, identified what 
she denoted as modes of teaching two or more concepts. One was the 
consecutive mode. Suppose two concepts A and B are taught in a temporal 
sequence. In the consecutive mode, the last move in teaching A precedes 
the first move In teaching &, We recognise this mode as prevalent in 
textbooks where ttiere is no feedback from the learner to the teacher and 
no diagnosis by the teacher is made, Pavelka found that this was the 
mode most frequently used by mathematics teachers, 

A second mode is embedlve. In this mode the first move In teaching 
concept b follows the first move in teaching concept A and the last move 
in teaching B precedes the last move in teaching A, In other words, all 
the moves in teaching B are between the first and last moves of teaching 
A, 

A third mode Is overlapping. In this mode the first move in teaching 
A precedes the first move in teaching B and the last move in teaching A 
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precedes the last move in teaching B. For example, the te<iching of a 
concept of a mixed number may overlijp the teaching of a concept of an 
improper fraction, and both of these may overlap the teaching of a con- 
cept of a proper frat^tion. 

What modes would be found when more than two concepts are taught 
in one class period? Is there a high correlation between the diagnostic 
ability of a mathematics teacher and the use of the embedive and over* 
lapping modes? Do the same modes appear when a sequence of principles 
is tau&ht? What modes would be found in a sequence Involving both con- 
cepts and principles? All these questions seem interesting to me. 

So far we have not studied the teaching of values in mathematics. 
I postponed this because it seemed easier to study the teaching of con* 
cepts, principles! and skills, Couitl the concepts of moves and strategies 
be used to analyze the teaching of Viilues? If so, what moves would be 
found? I can speculate, but I do not know. 

Finally, I have been interested in how students learn concepts with- 
out being taught them. There are many concepts In this category. Suppose 
students have been taught a Concept of equilateral figures and a concept 
of a triangle. Thereafter, the teacher would probably use the term 
equilateral trianfjle without deliberately teaching the concept. How do 
students acquire this latter concept? I can advance an explnnation based 
on logic. But I do uoL know whether this is the way the wtudL-nt mind 
operates. Or tJupposc- students have been Caught a concept of an equila- 
teral triangle. The teacher might subsequently use the term equil.ate_ral 
quadrilateral without taking time to teach this concept. If the students 
acquire the latter concept simply by hearing the term used, what is their 
reasoning process? Agaln^ I can offer a hypothetical explanation, but I do 
not know whether it is true of any student or of many students. Perhaps 
if we were able to answer questions like these, we would be better able 
to tcl] under what conditions a mathematics teacher can safely use a 
term without taking time to teach the concept it designates. 



Elements in a Pedaj;ogical Theory 

Regardless of what approach is used to develop pedagogical theory^ I 
would expect to find certain elements in the theory. Earlier, I suggested 
that a theory is a network of concepts and statements which are either 
knowledge or bellefs> In an empirical theory^ I would expect some of the 
concepts to be of sensed objects. Thus, In pedagogical theory we have 
concepts of students, teachers, classroom dialogue, overhe^id projectors^ 
and colored chalk, among many others because we sense each of these 
entities* 

Other concepts are inferred entitles — theoretical constructs. We do 
not sense these. We invent rather than sense such concepts as motive. 
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aptitude. Interest, proficiency, appreciation, understanding, concept, 
principlei skill, attitude, and many others because they aid us in 
explanation arid in Identifying researchable hypotheses* We explicate 
such concepts. If we ever do explicate thetii. In terms of sensed concepts 
and facts. I cite the current Interest in behavioral objectives as an 
attempt to explicate certain concepts which are inferred entities (compre- 
hend, understand, appreciate) in terms of observable entities (state, 
write, draw* lij^t, choosti) » 

The statements In a theory, unlike the concepts, have the character- 
istic of being known to be or believed to be true. Since pedagogical 
theory Is an empirical theory, T would expect most of the sj;atements 
to be empirical or factual. I would exptici' to find some analytic 

statements. Here are some statements that seem to me to be analytic i 

1. Given any test of computation in arithmetic, fifty percent of 
the students who take the test will not score higher than the 

median . 

2. If a teacher has Induced a desire to learn In a student, he 
has motivated the student. 

3. If an objective Is unachievable in the time available for schools- 
work, the teacher will not be successful in helping students attain 

It. 

4» Experience shows that students will either enjoy mathematics 
or not enjoy Lt. (Experience do^^s not show this; logic does.) 

5. If what a superintendent says is not credible, it will not be 
bel Leved . 

6. Relative to other people, a person^s adjustment mechanisms will 
bo toward other people, away from them, or against them. 

In quoting these statements^ which I found in books pertaining to teaching, 
I tim not ridiculing the writers. Analytic statements are unavoidable in 
a theory. They ate statements in the object language which are immediate 
implications of definitions or are instances of tautological formulas in 
logic . 

What is necessary for both a theoretician and a practitioner is to 
be able to tell when a sentence is used to make an empirical (factual) 
statement and when It is used to make an analytic statement. Let us 
take some exat^jpLes. 

"Slow learners cannot handle abstractions as well as average learners.*' 
Is this statement used to make a factu^il or an analytic statement? One 
cannot tell without obtaining answers to one or more questions. How are 
slow learners Identified? If trhey are identified by tests whose items 



53 

ERIC 



tesc the ability to handle abstractions, the statement is analytic. On 
the other hand, IE they are identified by behavior other than their ability 
to handle abscractlons* the statement is factual, 

"Good teachers motivate their students.'* Is It conceivable* i.e.^ 
possible* that a teacher could not motivate his students and still be 
regarded as a good teacher? If the answer Is *'yes,'* the statement Is 
empirical. Whether such teachers exist as a matter of fact is irrelevant; 
ail that matters is that it is logically possible for such teachers to 
exist. If the answer is **no /' the statement is analytic. Motivating 
students is a logically necessary condition for being a good teacher. 

'^Students never fail; only teachers fail.'* Even though this is 
declsrativd In form, I doubt that it is used to make a statement. It is 
a slogan. Nevertheless, there are individuals vho think that it makes 
a statement. Such individuals need to be asked to describe an experiment 
which would test this statement. If they cannot do this (and I think it is 
impossible to so) » they are using the statement as analytic. This they 
have every right co do. It is akin to '^If the student hasn't learned^ the 
teacher hasn^t taught." which is one of the basic tenets in their theory 
of teaching. Authors who make such an assumption should not talk or write 
as though it were a matter of fact* (As an aside^ perhaps one of the 
desirable outcomes of the thrust of accountability will be for teachers to 
divest themselves of these unfortunate slogans*) 

Some of the confusion in educational theory stems from the unawareness 
of the use of sentences which arc used to make factual statements a^id which 
are used to explicate the semantics of the theory. When parents, teachers^ 
or theoreticians disagrees about a statement^ the first thing to do Is to 
ascertain how the statement is being used. Once this is settled^ the kind 
of evidence that is relevant is determined. The search is for facts if 
the statement is u^od to make a factual assertion; it is for definitions 
or Logical propositions if the statement is used to make an analytic 
assertion. 

I now turn to another element that is present in a theory like ped" 
ago^^y which is regarded as primarily practical. This element is value 
judgments. In veil established and objective theories, the value judgments 
are Implicit. Thus^ nowhere In mathematical theory Is the explicit judgment 
that abstractness Is desirable. This goes without saying. Yet In peda* 
gogicfll theory we find abundant use of rating terms, e.g..^ good , important , 
signif icnnt ^ desirable , worthwhile , and their antonyms » to express value 
judgments. Their prevalence may be explained by the lack of agreement 
on basic values in education. With lack of agreement^ values need to be 
made explicit^ for they, In part^ determine choices of action. 

I presume that I need not argue that value judgments have a logic 
that is distinct from that of analytic and factual statements. Only 
the dogmatic or omnicient individual would attempt to extend Tarskl's 
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paradigm 

'Snow Is white' is crue if and only If snow is white 

CO 

^Hachemacics is good' ig true if and only if mathemacics is good* 

The firval elemenc in a theory I shall disctjss appears only in a 
cheory which Is regarded as primarily practicable. This elem^int Is hor* 
catory sCatemenCs, l,a,, exhortations co do so and dO or prescripcions 
concernirvg tiow to do something. Examples are; 

1' A teacher should meet the needs of his students- 

2, Subject matter that is too difficult for the students in ^ 
cliiss should iioc be choseUh 

Give the students experiences ivi which they have to apnly 
what they huved learned. 

Make students check their answers to problems- 

These exhortations are inferences ft'om factual statements ^nd values. 
They are used to ajvise, urgei or direct behavior. Hence their lojjic 
is different from that of assertions* Rather than beirvg judged on 
whether they are correct descriptions of the facts — Tarski's paradigm — 
they are judged either in terms of whether they can be defended by facts 
and values, or by whether following them attains some end that presum- 
ably Is accepted by both the person v#ho utters Che hortatory statement 
and the person who accepts it. We might regard the generalizations in 
a theory, both analytic and empirical, and the hortatory statements as 
the principles in the theory. It is these that give the theory power. 

Why are there more hortatory statements in pedagogical theory than 
in physics? It Is not because pedagogy is practical and physics Is 
theoretical or that pedagogy Is primarily concerned with human behavior 
and physics ig not, I suggest it is because the generalizations irv peda- 
gogical theory are less well established and the values less well 
accepted. If I wish to cool my cup of coffee, there are clear implications 
from established generalizations in physics which tell me what to do, 
I don't need prescriptions. But if I want to teach mathematics to certaiTt 
groups of studervts, e*fi*t those who live In the Inner city, there are no 
generalizations whose variables are quantified over well-defined domains 
froiD which I can infer reliable prescriptions* I need to be offered 
advice in hortatory language. As pedagogical theory attains generalizations 
for which there are few, if any, counterexamples, the need for hortatory 
language will disappear* 5uch generalizations will be products of theory 
construction and experimental research. The stimulation of both of these 
is, 1 jtadge, the main thrust of this conference. 
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The Role of Relative Efficacy Studies In the Development 
of Mathematical Concept Teaching Strategies! 
Sotne Findings and Some Directions 
John A. Dossey 
Illinois State University 



The Search for a Model of Concept Teaching 



lha Need for a Mpd^l 

For several years the subject matter of methods courses for pro- 
spective teachers of mathematics has been built atotmd a core of effi- 
cacious prescrlptloris drawn from teachers^ past e^eriences i educational 
psychology, theories of learning, and mathematics. While each of these , 
areas has something to offer the teacher, they do not provide the niathe- 
mattes Instructor with a firm foundation for educational decision making 
concerning the teaching process. 

These sources do not provide a rational framework for a careful 
analysis of the teaching act. The field of prior experiences Is fixed 
In timet and the conditions which led to a particular happening may 
never eventuate a^aln . The findings of educational psychology and the 
ramifi'iations of theories of learning do not offer the insight which 
was once expected of them; rather they focus on the learning aspect of 
the classroom situation and not on the teaching act. Hencet they are 
descriptive and not predictive. They do not provide a mirrored surface 
from which we can deduce theories of teaching* Other shortcomings of 
the findings in these areas and their values to the development of a 
theory of teaching are discussed In a paper by Henderson (1972). The 
field of mathematics does lend some guidance In that Its structure 
provides some information concerning the ordering of concepts and 
generalizations. However, ic does not aid In the selection of teaching 
strategies or materials for classroom instruction* 

These shortcomings have prompted several educators to call for the 
development of a ^"theory of instruction*^ or a **theory of teaching." 
Cage tV963) feels that such a theory should 
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attempt to explain how it is that the behavior of one 
person, a teacher^ can influence the behavior or learn- 
ing of another person, a student. This kind of theory 
would attempt to explain instances of teaching, i,e*» 
of interpersonal influence resulting in learning, Cp , 13^) 

Bruner (1966) builds on Gage*s c^ill for a "theory of instructioTi*' by 
stating four conditions such a theory should fulfill; 

First, a theory of instruction should specify the ways 
which most effectively implant in the individual a 
predisposition toward learning — learning in general or a 
particular type of learning, , . 

Second, a theory of instruction must specify che ways 
in which a body of knowledge should be structured so that 
it can be most readily grasped by the learner, , , 

Third* a theory of instruction should specify the 
most effective sequences in which to present the materials 
CO be learned* , , 

Finally, a theory of instruction should specify the 
nature and pacing of rewards and punishments in the process 
of learning and teaching, (pp, 40-^1) 

While no such universal theory exists* several different models have 
been proposed to serve as a framework for the analysis and study of 
teaching, Nuchall and Snook (1973) have provided the educational 
community with an overview of several of the more popular models for 
teaching. Their analyses consist of a study of the origins of the models, 
research stimulated by the models, and issues generated by playing the 
models off against each other. 

These models have been responsible for the generation of a multi-- 
tude of studies which have tested hypotheses concerned with attempts 
to better understand the act of teaching and to develop better methods 
of instruction* This paper will consider the development of the rational 
model of teaching as it interacts with concept teaching in mathematics. 
The origins of the Smith-Henderson model for concept teaching will be 
analyzed, the research generated by it reviewed, and a model for further 
studies will be proposed. 



Smith's Model 

The rational model for the study of teaching has its origin in the 
work of B* 0, Smith and his associates at the University of Illinois, 
Their work on the development of a model for teaching began in the late 
1950's. Smith (1956) argued that teaching is primarily a verbal activity. 
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With this in mind, the first attempts in the building of rhe model for 
teaching were audio-recortJings of the interactions which took place in 
classrooms when "^teaching" supposedly was taking place. The transcripts 
of the resulting dialogues were then subjected to a rigorous logical 
analysis to determine the manners in which teachers use language In the 
classroom. 

This analysis consisted of factoring the total classroom discourse 
into uults known as episodes , which consisted of a series of completed 
verbal exchanges between two or more speakers, and mono lo^uej^ , which 
consisted of the words of a single speaker. The e^tamination of the 
various uses of language revealed that teachers use language to define, 
designate, classify, ejcplain, compare*-cont rase , evaluate , and offer 
opinions <Smith» Heux, Coombs, Eierdam» fit Szoke» 1970). This srudv was 
quickly followed by a second study. Here, the emphasis was shifted from 
the factoring of the total discourse into recognisable units to a study 
of the sequencing of these units into strategies for dealing with 
different types of subject matter material, such as concepts and princi- 
ples (Smith, Meujc, Coombs, Nuthall, & Precians, 1967). 

Smith chacacceri^es the action in the classroom as a game played 
between a teacher and a class. This situation involves both mutual and 
conflicting goals. The teacher attempts to attain his goals through his 
action in the classroom, whether it is wich student cooperation or 
student resistance. It Is here that the game theory concept of a strategy 
enters. Smith et al. (1967) stated that: 

Pedagogicallyj strategy refers to a set of verbal actions 
that serve to attain certain results and guard against others. 
From a general standpoint, strategies may serve to In^Juce 
students to engage In a verbal exchange, to insure that certain 
points in the discourse will be made clear, and to reduce the 
number of irrelevant or wrong responses as the students parti- 
cipate In discussion and so on. Of course, strategies also 
enhance the possibility that the cognitive import of the 
venture will be attained; that is to say, the objectives 
such as explications of concepts, elaborations of causal 
conditions, and the presentation of Information will be 
successfully carried out. (pp. ^9^50) 

This formulation of a pedagogical strategy then served to provide 
a framework for a logical development of a model of classroom teaching 
in terms of teachers* verbal moves.' The total verbal discoui^se of the 
classroom was divided into units aligned with the teacher's objectives. 
The yent^ur^ unit contains all of the material related to a single over- 
arching objective. Each venture Itlentified in the discourse was then 
split into smaller divisions called moves . The moves are the various 
forms in which a teacher logically structures the subject matter mate- 
rial as he attempts to move toward his objective. It Is the sequencing. 
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or patterning^ these moves Chat gives rJse to the concept of a 
strategy which Smith refers to in the passage quoted above. 

One of the classes of ventures identified in this study of class- 
room ter^ching was chat of a conceptual venture. The objective of 
ventisireiij of this type was the development of a student's ability to tie 
a sec of meanings and a particular term together in such a vay chat the 
student has command over usage of Che Cerm. This model of the relation 
of conceptualization has been expanded upon by Hendei son (1963). 

The analysis of the audiotapes of classroom veroal interactions 
showed that when teachers are dealing with the teaching of concepts, 
they are not concerned with teaching how to categorize or discover the 
definin^^ aCCrlbuCes of a particular concept, as they are often called 
on to ilo in laboratory sCudies of ooncepc aCCainment. Rather, SmiCh et 
al. (1967) found that the teachers were 

concerned with the explication of the kind of information 
which results in students being able to describe the concepCj 
Identify differences between the concepts and some other 
concept* and to understand the concept in learning about 
more advanced subject matter. Cp. 60) 

These findings were also noted by Carroll (196^)» 

When the taped classroom interactions were viewed from this pointy 
Smith and his coworkers were able to detect four tnain categories of moves 
used by teachers in dealing with concepts. 

1* Descriptive moves . In these segments of verbal discourse, the 
teacher gave characteristics of the concept of concern, analyzed the 
concepti or classified the concept. 

2. Comparative i;ioves . These moves consisted mainly of attempts to 
give analogies between concepts or to dif ferenti^ite between concepts. 

3. Distanttation moves . The moves In this set were concerned with 
providing e;^amples» nonejcamples » or the production of justification of 
eicher examples or nonexamples of the concept in question. 

Usage moves^ . The only move identified in this class was the 
move called the meta-distinction move * The meta-distinction move is one 
in which the speakt^r discusses the term which names the concept of 
interest. 

The four categories and the moves contained in each resulted in the 
following taxonomy of concept teaching moves: 
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1* Descriptive Moves 

A* Characteristic move 

B, Sufficient condition move 

C, Classification move 

Class If lea tory description move 
E, Relations among characteristics move 
F* Analysis move 

11^ Comparative Moves 

A, Analogy move 

B, Differentiation move 
Instance comparison move 

III, Instantlal Moves 

A, Positive Instance move 

B. Instance enumeration move 
C*. Negative Instance move 

D, Instance production move 

E* Instance substantiation move 

IV*. Usage Moves 

A*. Meta-distlnctlon move 

After Identifying the classes of moves and the types of moves contained 
wlthifL them. Smith and his coworkers described the strategies they 
found In their analyses of audio Interactions concerned with concept 
teaching.. Seven patterns of concept teaching emerged, but only four 
were employed in over ten percent of the concept ventures studied 
(Smith et al., 1967), 

The most prevalent pattern was the one Involving only descriptive 
moves. This strategy was used in thirty percent of the ventures cited. 
The second roost couflftoti strategy was that of a group of descriptive 
moves followed by a group of several Instantlal moves.. This sequence 
occurred in twenty-seven percent of the ventures. The third type of 
sequencing pattern noted was that of a group of descriptive moves 
followed by a set of comparative moves.. This strategy was used, about 
sixteen percent of the time In concept venture situations.. The fourth 
major strategy was found to be a combination of descriptive, compara* 
tlve, and Instantlal moves^ It made up about twelve percent of the 
concept ventures Identified.. 

This same study (Smith, et al..f 1967) also showed that the combi- 
nation of moves used in teaching a concept, as well as their length 
and order, varied from one subject matter area to another.. Some examples 
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of strategies noted shovn in Figure 1. The numerals in Che circles 
represent Che type of move used with respect to Smith's taxonomy. The 
"D/' '*C/' and "I/' In the circles indicate whether the move was a 
descriptive^ comparative* or instantlai move. The multiple lines Indi- 
cate the number of times the pattern of moves was observed. This analy* 
sis indicated chat the logical nature of the concepts and their subject 
matcer afflliacions mlghc determine boCh the naCure of the strategy and 
che cypes of moves concained wichin ic. 

Ch^m^scry Teacher Biology Teacher 



CV OCl CO CO Jifrid) (End) (d) (i) jTEn 



Figure 1* Some examples of Ceacher sCrategies for concepC teaching (SmlCh 



Henderson^s Model 

A Study of the Strategies of Teaching (Smith et al . , 1967), combined 
with Smith*s earlier work^ led Henderson to propose a set of moves for 
the teaching of concepts in mathematics (Henderson^ 1967). This set of 
moves was designed with respect to a functional taxonomy of concepts which 
Henderson (1970) proposed to help in che seleccion of concepC ceaching 
moves and strategies for Ceaching concepcs*. This Caxonomy will be 
discussed lacer in Chls paper. 

Henderson noted that a term can be used in Chree differenC ways* 
FirsCj a term can be used to talk abouc the characteristics of che 
elements irt a term's referenC sec* This is said Co be a use of the 
term*s connotation. Second^ a term is used in labeling objects or ideas 
as being members or nonmembers of the term's referent set. Here the 
teacher uses tlie term's denotation* In both of these instances, the 
teacher is talking about the concept in the object language. A third use 
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of the term occurs in the iDetai£inguage, Here the speaker uses the term 
in talking <ibout the term itself. This type of usage of the term Is 
s^id to use Its implication. It was from these three uses of a term 
which names a concept that H^nderson^s taxonomy of concept n;oves was 
developed. 

The following analysis gives a full explication of Henderson's 
taxonomy of concept: teaching moves, as well as their relationship to 
the use of the concept naming term. The first moves in the taxonomy 
are the moves in the object language. These moves are divided into 
the set of c^haract eristic moves , which deal with the connotation of the 
concept naming term, and the set of exemplification moves , which deal 
with the denotation of the concept naming term. The second set of 
concept teaching moves are the moves ii> the metalanguage. These moves, 
called definitional moves , deal with the implication of the concept 
naming term. 

Henderson's set of moves used in the teaching of mathematical 
concepts is briefly stated in the following ourline: (See Henderson^ 
1967 for a more detailed description). 

I, Hoj/es in the object language . 

A. Based on characterization ^ Characterization moves are those 

in which a person talks about the characteristics or properties 
of the objects in the referent set. 



1, 


Single characteristic 


2, 


Sufficient condition 


3. 


NeCossary condition 


4, 


Classification 


5. 


Ident i ficat ion 


6. 


Analysis 


7. 


Analogy 


8, 


Differentiation 


9, 


Comparison and/or contrast of members of the referent set 



B. fiased on exemplif icarion . Exemplification moves are rhose In 
whLch a person naines members and nonmembera Of the rftferent 
set. Or one person designates an object and asks another to 
determine whether or nor the object is a member of the referent 
set . 

1. Example 

2. Nonexample 

3. Counterexample 

4. Specification 

5. Exemplification accompanied by justification 

6. Nonexemplif ication accompanied by j^istif lea tion 
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TI. Moves In Che metalansuase 

A. Stipulated definition ^ A meaning; is ascribed to a term 
which is to designate a concept. 

B*. Reported definition . The conventional meaning of a term 
designating a concept is reported. 

With Henderson's analysis of the various types of moves used In 
teaching a concept, one has a tnodel for considering the relative 
efficacy of various strategies used by teachers and teaching materials 
in structuring conceptual ventures in mathematics. Expanded informa- 
tion on several of the above moves is available in a slightly n»odified 
version of Henderson's taxonomy in Dynamics of Teaching Secondary School 
Mathematics (Cooney, Davis, & Henderson, 1975). 

The formulation of a classroom concept teaching strategy must take 
Into account the logical nature of the concept, the nature and amount 
of ij 'ormation carried in various exemplars of the concept, and the 
theorttical advantages one type of move might possess over another 
type of move. The starting point for such studies might be In the 
translation of Smith's strategies into the nomenclature of Henderson's 
taxonotny * 

Because Henderson's taxonomy has only two classes of moves In the 
object language, shifting from Smith's model to Henderson's model for 
teaching concepts condenses the strategies mentioned' earlier into two 
general types. The strategy types noted earlier are now characterised 
as consisting entirely of characterisation moves or as being a mixture 
of characterization and exemplification moves. If such sequences are 
given an alphabetic designation by letting a '^C" denote a string of one 
or more chiiriiCterlsatlon moves and an "E" denote a string of one or mote 
exemplification moves, the strategies might be called C strategies, or 
CE, EC, CEC, or ECE Strategies. 

An analysis of the common concept strategies used by teachers In 
A Study of the Strategies of Teaching (Smith, et al*., 1967) In terxns 
of Henderson's "C" and '*^E*^ moves gives sequences as shown in Figure 
2. The C' and E's in the circles indicate whether the moves are from 
the cjiaracterisatlon set or the eyemp li f ic at ion set*. The set of letters 
at the end of the branches of the tree network indicate the type of 
strategy represented by the path through the network terminating at 
that mode. 



START 

Figure 2. Examples of common strategies seen over many teachers. 
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Early Research Studies Concerning Concept Teaching Strategies 
GinU^er's Study 

The next study which attempted to unravel the question of what stra- 
tegies are used in teaching mathematical concepts was conducted by 
Ginther (196^)* (Ginther^s study is reported in Glnther and Henderson 
(1966)-) Ginther made a survey of twenty-three algebra and geometry 
texts to identify the instructional strategies employed in the handling 
of definitions- Ginther classified the definition teaching moves on the 
basis of whether the moves designated the objects denoted by the term 
being defined^ gave a set of necessary and sufficient conditions for an 
object to be labeled by the term being defined, or by giving a term 
claimed to mean the same thing as the term being defined* These three 
classes of <Jefinitions were called denotative , connotative , and synony - 
mical definitions respect ively- 

The results showed that in both algebra and geometry connotative 
definitions were used most» and synonymical definitions were used least* 
An analysis of the percentages of each type tised in each subject showed 
a difference between the types of definitions, as shown in Table 1 below 
(Ginther & Henderson, 1966)* 



Table 1 

Percentage of Each Definition Type Appealing 
In Algebra and Geometry Textbooks Surveyed 



Definition Type 


% of Algebra Moves 


% of Geometry Moves 


Denotative 


29 


10 


Connative 


66 


89 


Synonymical 


5 


2 
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An analysis of these percentages indicates that the authors of the 
texts surveyed may think that characteristics* or properties^ of the 
objects in the concept's referent set are the most important factor in 
the attainment of a concept from written materials. This conviction 
seems to be stronger in geometry than in algebra* as the percentage of 
connotative definitions in geometry was 89* while the percentage; of 
connotative definitions in algebrii was 66, The denotative definition 
moves ranked second in order of usage in both the algebra and geometry 
materials. They accounted for 29% of the definitional moves in algebra 
and' lOX of those in geometry. This finding might be interpreted as 
meaning that authors of textual materials in mathematics feel that the 
use of examples is more Important in the teaching of algebra than It is 
in the teaching of geometry. Another interpretation for the drop in 
denotative moves as one changes from algebra to geometry could be the 
amount of page space required for denotative moves in a geometry text. 
The use of synonymical definitions was found to be the least used 
strategy both subject matter areas. This finding agreed with Smith's 
et al, (1967) findings concerning the mets-distinct ion move. 

When the total strategies for presenting definitions were examined* 
Ginther found four basic patterns. These patterns qan be considered 
concept teaching patterns, for the definition teaching strategies were 
designed to place a specific meaning with a particular term. The basic 
patterns denoted by Ginther were explanation-definition* definition- 
explanation, explaoation-def tnition-expianatiorit and definition, 

Ginther*s work was important in that it established the existence 
of four <lifferent instructional strategies which appeared in contemporary 
mathematics texts. In addition, it noted the differences In the use of 
the three classes of definitional moves ±n algebra and geometry texts, 

Rector^s Sj.udjT 

The first study to empirically test the relative efficacy of different 
concept teaching strategies for mathematical concepts was done by Rector 
(1968) (Rector's study is reported in Rector and Henderson (1970) , ) 
Rector arrived at four strategies to examine by making a liberal trans- 
lation of Ginther's definitional strategies into Henderson's concept 
move language. This was done by substituting characterisation moves for 
Ginther's definitional moves and exemplification moves for Ointher's 
explanation moves. This resulted in the following four strategies; 

1, a set of exemplification moves followed by a set of character!-' 
zation moves, 

2, a set of characterisation moves followed by a set of exemplifi- 
cation moves, 

3, a set of exemplification moves followed by a set of characteri- 
sation moves followed by still another set of exemplification 
moveSt and _^ 
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a set of characterization moves. 

Using the alphabetic made of representing strategics, these four strategies 
would app«isir as EC, CE, ECE, and C Strategies respectively, 

- Rector compared the relative efficacy of these four strategies for 
their ability to Influence student acquisition of eleven concepts from 
elementary probability theory. Rector developed programmed instructional 
materials in which the strategies, each consisting of five moves per con- 
cept, were structured as follows; 

1, Characterisation Strategy (C) , This instructional strategy con- 
sists of five characterization moves, 

2, Charac terizat ion- Exemplification Strategy (CE)^ , This ingcruc- 
tionaL strategy consists of a characterization move followed by four 
exemplification moves, 

3, Eicempliflcation-Characterization Strategy (EC) . This instruc- 
tional strategy consists of four exemplification moves followed by a 
cha^ac^erlzation move. 

4, Eyemplificat ion-Char act erizat ion-Exemplification Strategy (ECE) , 
This instructional strategy consists of two exemplification moves followed 
by a characterization move followed by yet another set of two exemplifi- 
cation moves , 

To test the relative effectiveness of the four strategies. Rector estab- 
lished a taxonomy of cognitive behaviors patterned after that developed 
by Bloom, Englehart, Furst, Hill, and Krathwohl (1956), Rector collapsed 
Bloom's taiconomy into the following three levels; (a) level one^ know- 
ledge and comprehension; (b) level two, application; and (c) level three, 
analysis, synthesis, and evaluation. In addition to these three levels. 
Rector totaled the criterion test scores for each level to get a score 
which represented the student's performance over a broad range of educa^ 
tlonal goals and cognitive behaviors, 

A second factor in Rector*s study was the inclusion of a classifi- 
cation factor dealing with the levels of mathematical ability present 
in the students who served as subjects. The students were divided 
into high and low mathematical aptitude groups on the basis of their 
performiances on the mathematics subtest of the Scholastic Aptitude Tes t. 

If H is used to represent those classified as having a high methe- 
inatical aptitude and a L is used to represent those having a low mathe- 
matical aptitude^ the design of the study could be represented as shown 
in Figure 3, 
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C 



CE 



EC ECE 





A A 

1 L H L 



H 



L 



H 



L 



Figure 3, Design of Rector's ^ x 2 factorial research model 

The instruction in the study wag carried out through the niedium of 
progratnmed instruction.. This mode vas chosen because it allowed for 
cotnplete control of the moves beirtg usedt and it equalised the personality 
and competency questions sometimes referred to in studies comparing 
teaching techniques*. 

The experimental materials were given to a group of undergraduate 
students who served as a sample, and they were allow^^d to work through 
the materials in dads time. The criterion test was administered three 
days after the students had completed the programmed materials*. 

A two-way analysis of variance was run on the data from the 4x2 
design*. The analysis » run for each of the three cognitive levels and 
the total test scores, resulted in only one significant difference <at 
the .05 level) « other than aptitude differences. This finding suggested 
that the C-strategy was significantly better than any of the other 
strategies in promoting student acquisition of the concepts at the Level 
I, knowledge and comprehension, stage of cognitive behavior. No other 
differences were found between the C, CE, EC, and ECE strategics or 
Interactions between them and the levels of the aptitude factor^ (These 
results are reported In Rector and Henderson (1970)*.) 

Rector <1968) hypothesised that the significance of the C-strategy 
at the knowledge and comprehension level was due to the fact that it 
allowed the students to focus on the relevant material quicker and that 
It made fewer demands on the student than the other strategies*. The 
other strategies, EC, CE, and ECE, required the student to infer some 
facts about the concept from the exemplification inoves contained within 
the strategy*. The knowledge and comprehension level of evaluation also 
calls for a more direct form of remembering and dealing with the inform 
matlon than the other levels of the taxonomy of cognitive behaviors. 
The lesser demands of the C-strategy on the student combined with the 
lesser demands of the level of evaluation of the C-strategy niay be the 
factors which lead to the significance of the C-strategy at the Level I 
s tage . 



Rollins' Study 

A second study conducted at the University of Illinois in the same 
general time period was the work of Rollins (1966)*. His study tested 




ERIC 



-63- 



the relative efficacy of three strategies for teaching mathematical con" 
cept6 and generalizations by guided discovery* (Rollins* study Is reported 
in Rollins and Henderson (1967).) 

Rollins proposed that a general guided discovery pattern consisted of 
the following decisions on the teacher's part! 

1* The teacher selects a generalization with which he hopes to 
guide the students Into discovery* 

2. He selects Instances of the generalization and presents them 
to the pupils* 

3. He directs the pupils' thinking relative to the instances by 
Tneans of prescriptions or leading questions* 

4- He seeks evidence of abstraction by the pupllSj that Is 
seeing the common form (pattern) amid the differences* Valid evidence 
Is qulcltness in giving the correct response or 3 statement of the correct 
generalization* 

5* tf such evidence Is abundant^ the teacher concludes that the 
pupils have discovered the generalization. If not» he repeats steps 
2f 3j and 4, using new instances and perhaps employing various pedago- 
gical aids to make the pattern more evident. (Rollins & Henderson^ 
1967^ pp. 583^584) 

Within this set of stepSf various strategies for concept teaching 
might be identified if one views concept teaching from the standpoint 
of getting students to obtain the necessary and sufficient conditions 
for the use of the concept naming term* These different strategies 
would result from the selection of examples and nonexamples for steps 
2 and 3 above^ as well as the sequencing of these exemplification moves. 
The three strategies chosen for use in the Rollins study were adaptations 
of three inductive strategies which he ascribed to John Stuart «1U (1872)* 
These three strategies were: 

1. The stratagem of agreement . This strategy used the approach of 
presenting a se<|uence of examples from which one could Infer that **Every 
case of p. is also a case of q.** Other factors In the examples would be 
present In some cases and absent In others^ thus allowing the subjects to 
decide which factors are necessary or sufficient conditions for an object 
to be a member of the concept*s referent set- Only factors p and q would 
be present In all cases. The students could then Infer the stated genera- 
lization* 

2* The stratagem of difference . This strategy used the approach of 
presenting a se<|tjence of examples and nonexsmples of the concept. The fac^ 
tors Involved In these cases should lead the student to infer that "Every 
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case of p is also a case of q/' One example might show that both P 
and q hold in the £ace of other factors, while another example shows 
that when the Irrelevant characteristics or the prior example hold and q 
is absentt p is also absent*. This strategy uses the logic of the contra- 
positive*. 

3. The joint stratagem of agreetaent and difference ^ This strategy 
is a combination of rhe two ptevloos strategies and provides the student 
with seemingly better information on which he can infer the statement 
"Every case of p is also a case of q/' This strategy^, due to its con- 
struction from the two previous strategies, is best analysed in the form 
of two different subst rategies *. 

a. The paired instances stratajgem of agreetnenr and difference . 
In this aubstrategy, each example of the necessity^ and 
sufficient conditions obtained by the stratagem of agree- 
ment Is followed by an example generated by the stratagem 
of difference*. 

b*. The nonpaired instances stratagem of agreement and dlfferenc^ > 
In this substrategy^, all the examples derived from one of 
the stratagems are presented and then all of the examples 
derived by the other are presented*. 

Rollins selected ten concepts from the secondary school geometry 
curriculum, which wete unfamiliar to a group of junior high school stu- 
dents, fot inclusion in a programmed instruction unit*. The materials 
were prepared according to the stratagems of agreement, the paired in- 
stances stratagem of agreement and difference, and the nonpaired instanced 
stratagem of agreement and difference*. The three forms of concept teach* 
Ing materials were designed so that the evaluation of student achieve* 
ment was contained within the materials. An unreported number of Instnic* 
tional frames were used first then four frames were used to test the 
subject's attainment o£ the concept of concern*. 

These programs were then randomly assigned to a sample of eighth- 
grade mathematics students who had been grouped into high, average, 
and low ability groups on the basis of their performances on the 
California Short Form Test of Mental Maturity so that the three stra- 
regies were crossed with the ability groups*. 

The results of the evaluation frames when subjected to a two-^way 
analysis of variance showed the following findings: 

1. Students were capable of learning the concept from any 
of the strategies. 

2. Students of high ability learned the most and students of 
low ability learned the least. 

3. Hone of the hypotheses suggesting that there were no differences 
in the relative efficacy of the three strategies were rejected. 
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4* None of the hypotheses suggesting that the interactions were 
the saoie between the strategies and the ability levels were rejected* 

Afi a result of these findings^ Rollins and Henderson <1967) concluded 
that: 

In light of these findings it would seem that teachers, 
textbook writers, and programmers of automated teaching 
devices who wish to use inductive stratagems in teaching 
concepts and generalizations need not limit themselves to 
any one of the three stratagetns investigated in this experi- 
ment* It would appear that, whichever stratagem is chosen, 
students of all abilities will learn from it* <p» 588) 



The Search for New Domains for Relative Efficacy Studies 

The foregoing studies found no significant differences of note in 
the relative efficacy of various patterns of moves in teaching mathema- 
tical concepts* Hence, one might wonder about the viability of the 
rational i7K>del of teaching for suggesting researchable hypotheses* In 
an effort to find situations where strategies might be especially 
effective, researchers examined findings of laboratory studies of 
human concept learning to identify typical learning problems* When 
such problems were identified, the laboratory findings were trans- 
lated into factors in the language of the strategies of a teaching 
model* These factors could then be evaluated for use in relative 
efficacy studies from the standpoint of their logical structure* 

Rosenshine and Furst (1971), in reviewing research on teacher per- 
formance criteria, suggested that more notice should be taken of the 
results of laboratory studies of meaningful human learning* In addition, 
they suggested that more attempts should be made to follow the strategy 
mode'' for conducting research on teaching* Both of these suggestions 
seemeu to indicate that more relative efficacy studies should be attempted, 
but with more considerations of laboratory findings and their implica- 
tions for developing effective teaching strategies. 

An analysis of the foregoing teaching strategy studies showed that 
they dealt only with the teaching of concepts in general* There was 
no particular effort by Rector or Rollins to identify the type of 
concepts being taught or whether types of teaching strategies might 
be differentially effective for various types of concepts. Looking at 
Ginther's study suggests that there might be some difference in the 
ways in which algebraic and geometric concepts should be handled* 



Laboratory Studies of Concept Learning^ in Humans 




Little analysis has been given to the logical types of concepts identified 
by Henderson In his functional taxonomy of concepts or other niodels of 
concept types developed* by others. 



Bruner's Analysis of Concept Types 

Bruner, Goodnow, and Aastln (1956) partitioned the class of concepts 
Into three subsets: conjunctive concepts, disjunctive concepts, and 
relational concepts. These three types of concepts are determined by 
the manner In which their defining conditions are coioblned.. 

A conjunctive concept Is one determined by the joint occurrence of the 
appropriate values of Its defining attributes. It Is characterized by the 
use of the logical connective "and*." A disjunctive concept Is one which Is 
noted by the occurrence of ^t least one of the appropriate values of Its 
defining attributes. It is set off by the use of the logical connective 
"or." The third type of concept, the relational concept . Is one which la 
determined by an explicit relationship between the values of the defining 
attributes. 



Hendersor's Analysis of Concept Types 

Henderson (1970) proposed a different partition of the class of con- 
cepts based on logical uses and properties of concepts. The general classes 
he offered were; denotative, nondenotatlve^ and attributive. A denotative 
concept Is a concept which has a nonempty referent set. A nondenotat lye 
concept, on the other hand, is a concept which has an empty referent set. 
The class of denotative concepts can be further partitioned Into the sub- 
classes of singular and general denotative concepts. A singular denota^ 
tlve concepj. Is one with a single element In Its referent set. A general 
denotative concept is one which has more than one element In Its referent 
set. An attributive concept Is a concept vhl^h does not have a referent 
set associated with It. Rather, It refers to a property that characterizes 
a particular set of objects. Ideas, or actions. Fbr example, one might 
have Idea, or concept, of "rigor" In matheioatlcSt but the term "rigor" 
does not act as a sorter to partition some domain Into escaraples and non- 
examples of rigor. 

Henderson (1970) further developed his functional taxonomy by differen- 
tiating between concrete and abstract concepts. A concrete concept Is a 
denotative concept which has concrete elements In Its referent set. An 
abstract concept - is a denotative concept which <joes not have concrete 
elements In Its referent set. Most of the concepts in mathematics are 
abstract denotative concepts. In the remainder of this paper. It Is 
this class and Its subclasses which will be the concept of concern. 

In addition^ this functional taxonomy of concepts can further be 
divided Into conjunctive and disjunctive subclasses in accordance with 




Bruner*a classification. The results of such classifications of concei>ts 
leads to a taxonomy of concepts shown In Figure 4* 



Jenotativc' 



Concepti 




oncrete 




abstract 




singular^ 



general ' 



singular*: 



gene ral-* 



^conjunctive 
-disjunctive 
.conjunctive 
-disjunctive 
-conj unctlve 
-disjunctive 
^conjunctive 
-disjunctive 



^nondenotative 



'attributive 




singular 



eneral 



Figure ^, The combination of Henderson and Bruner's taxonomies of toncept 
t y pes . 



Research Disjunctive Concept Learning 

The majority of studies dealing uith the nature of learners* concept 
attainment strategies for conjunctive and disjunctive concepts indicated 
that subjects encountered more difficulty uith disjunctive concepts* 
Bruner et al* <1956) attributed the difficulty to the following reasons*' 

1. the inability of subjects to profit from the information contained 
In nonexamples of the disjunctive concepts, 

2, the general tendency to avoid disjunctive concepts and dis- 
junctive situations in life* and 

3* the failure of conjunctive attainment strategies in di^ijunctlve 
concept situations* 
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Hant and Hovland (i960) sugg&sted that: many subjects confuse the 
Bieanlngs of the terms "and" and "or-" In separate studies* Wells (1963) 
and Shore (1964) obtained results that indicated disjunctive concept 
attainment could be improved with training in identifying disjunctive 
situations* Snow and Rablnovitch (1969) compared the relative difficulty 
of disjunctive concepts with 9- to 13-year--olds. Their results showed 
that the disjunctive concepts were harder to attain at each age level than 
the conjunctive concepts. Snow and Rabinovl tch's findings* when combined 
with Bruner's findings* imply that disjunctive concepts are harder to 
attain at all age levels- 



Recent Studies of the Relative Effectiveness of Various 
Concept Teaching Strategies 

Dossey*s Stujies 

With these laboratory findings in mind, a study (Dossey, 1971) was 
designed to test the relative efficacy of four instructional strategies 
for teaching disjunctive concepts in mathematics. The CE, EC^ and ECE 
strategies identified by Ginther and used by Rector were chosen as well 
as a CEC strategy identified in an analysis of audiotapes of classroom 
teaching of disjunctive concepts- The C strategy, identified and used 
in earlier studies, was eliminated from this study ad it contained no 
exemplification moves, A major factor in this study was the role 
exemplification moves play in the subject's attainment of specified 
disjunctive concepts* (Do3sey*s study is reported in Dossey and 
Henderson (1974).) 

The four strategies used in the study were the following; 

1- Chatacterizatlon-Exemplif ication Strategy (CE) . This instruc- 
tioTial strategy consists of four characterisation moves followed by a 
set of six exemplification moves* 

2 . Characterlzatlon-Exemplif icatlon-CharacteTlsation Strategy (CEC) > 
This instructional strategy consists of two characterisation moves followed 
by six exemplification moves followed by an additional two characterization 
moves t 

3- Exempl I flea cion-CharacCerisat ion-Exemplification Strategy (ECE) , 
This instructional strategy consists of three exemplification moves 
followed by four characterization moves followed by an additional three 
exemplification moves ^ 

Exemplification-Characterisation Strategy (EC) . This instruc- 
tional strategy consists of six exemplification moves followed by four 
characterization moves* 
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An exompie of a disjunctive conceptj due to the nature of the logical 
struct^ire of the concept, is an object or idea which satisfies at least 
one of the defining conditions of the concept. It is no^ necessary that 
it ftjlfili all^ of the disjvincts, or defining conditions, as in the case of 
a conjunctive concept. To be a member of a disjunctive concept's 
referent set it is sufficient for the object to satisfy only one of the 
several defining conditions for the concept, Mence, the attainment of a 
Jisjunctive concept through a sequence of positive exerDpllf ication moves 
amounts to a difficult information processing problem, 

A nonexapple of a disjunctive concept must Interact with each of the 
dLsjunccs in the defining statement for the concept. This follows from 
the appliciition of DeMorgan's law for the formation of the negative of a 
disjunction (Kx:ner (t Rosskopf, 1959), The resulting statement is a con- 
junctive statement each of whose conjuncts is ^ negation of one of the 
disjuncts of the original defining statement for the concept. This 
nonexample ^lefinlng statement must interact with each of the defining 
conditions of the disjunctive concept^ . Hence, the use of nonexamples 
in teaching disjunctive concepts involves the relevant properties more 
often than the use of examples would* 

In theory, it seems as if a teaching strategy for disjunctive concepts 
employing a K'jrge number of nonexample moves might be more efficacious 
thfin one employing a smaller number of nonexample moves. This thought 
resulted In tlie insertion of an exemplification approach factor Into the 
study, Zts levels were; 

1, jjonexamp lo Approach (-^E), In this level of the exemplification 
approach factor, the ratio of nono.nmple to example moves Is 2:1, 

2, Example Apjjroach <E) , in this level of the exemplification 
approach factor^ the ratio of nonexample moves to example njoves Is 1:2, 

The insertion of the exemplification approach factor into the study 
suggested that nonexample moves might interact differently with students 
of differing intellectual ability levels; hence, a third factor, intellec- 
tual ability wrjs added to the study. The subjects were divided into 
high and low ability groups with respect to the intellectual ability factor 
on Lhe basis of their performance on the Henmon Nelson Tests of Mental 
Matu^ri_tjr, 'fhc resulting experimental design was a 4 x 2 x 2 completely 
crfjfssed factorlaj. design with 16 cells, A pictorial model of this design 



Is given in Figure 5, 
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Figure 5, Pictorial niodcl of design used in Dossey ' s study* 
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Two Other points of interest were built into the study although they 
were not afforded a full factor status* The twelve disjunctive concepts 
were divided equally along the lines of algebraic and geometric conceptSj 
as well as along the lines ot whether the use of the term "or" in the 
concepts was in the inclusive or exclusive sense* 

Progranuned instructional materials were then prepared to teach the 
twelve contrived disjunctive mathematical concepts to the undergraduate 
students who served as subjects in the study* A sample page from the CEC 
example approach program, teaching the concept of a preve follows (Dosscy, 
1971). 

A natural number which is either even or prime is called a 
preve . Hence, the set of all preves could be thought of as 

the of the sec of all even natural numbers 

and the set of all prime numbers* 

It. 7 is a preve because it is * On the other 

hand J 9 is not ^ preve because it is not^ and 

not * 

ITT* Give an example of a preve, other than 7, which is iess than 

20* 15 is not a preve because it is not 

and it Is not 



TV* TelJ why ^7 Is a preve. 



V, Give an example of a preve between 30 and 40 and tell why you 
believe it is a preve* 



VT* E>cplain why the set of all preves is not equal to the set of 
even natural numbers* 



VTl* One could summarise the requirements for a natural number to be a 
preve by stating that a number must satisy what conditions? 



A criterion teat was constructed to measure the subjects' attainment 
of the concepts at each level of the cognitive behavior model developed 
by Rector {1968)* A pilot study of the programs and tests showed that 
there were no significant difference in the times by the subjects to com- 
plete the different forms of the programmed units* Reliability checks 
for thi. total and cognitive level subtests showed they were appropriate 
for use the experiment* 
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The data from the tests was submitted to a thri>e-way analysis of 
varlaQcc, The analysis showed that the high ability students scored 
significantly higher than the low ability students at every level of 
comparison^ 

At the Level I (knowledge and comprehension) stage j sif^nlf leant 
differences existed in the exemplification approach factor. A review of 
the means showed that the ^xiampie approach factor was more effective in 
promoting student attainment of concepts, 

Wlien the restilts of the Level II (application) stage, were studied, 
a significant difference wns found to exist among the different strategy 
approaches, Duncan*s New KviltlpLe Range Test (Edwards, 1968) suggested 
that the CEC strategy was more effective than the ECE strategy, and all 
jother pairs of strategy means had no significant differences between tliem. 

At Level III (analysis^ synthesis, and evaluation) stage, both the 
strategy and exemplification approach factors had significant differences 
among their component parts. The exemplification approach using four 
example moves and two nonexample moves vas significantly more effective 
ttian the nonexample approach. On the strategy factor, the CEC^ CE, and 
EC approacheiJ were significantly more effective than the ECE approach. No 
other pairs of means for the strategy types had significant differences 
between them. 

An annlysls of the subjects* performance on the total test was carried 
out to examine the influence of the strategies and exemplification approaches 
over a wide range of educational objectives and cognitive levels. The 
application of Duncan's N^w Multiple Range Test to the strategy means 
indicated that the CEC and EC strategies were more effective in promoting 
the student learning of the disjunctive concepts than the ECE strategy. 
An analysis of the means for the exemplification approach factors indi- 
cated that the example approach was more effective than the nonexample 
approach. 

An analysis of the scores on the algebraic and geometric items showed 
that the geometric Items were significantly easier for the students to 
handle than wore the algebraic Items. Ttie comparison of the exclusive 
concept scores with the inclusive concept scores showed that the exclu- 
sive concepts were significantly easier for the students to handle than 
were the inclusive Items* 

The analysis of the results on the algebraic items indicated that 
there was a difference in the relative efficacy of the four strategies 
for helping students attain the concepts, Scheffe's test for Multiple 
Comparisons (Wlner^ 1962) was then applied to the stratugy treatment totals 
for the algebraic Items, The results of several comparisons turned up 
only one comparison which was significant at the 0,05 t^dvcl. The 
difference showed that thij CEC strategy w^iti significantly better than 
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the ECE strategy in helping students attain the algebraic disjunctive 
concepts* No other differences were noted among the strategy treatment 
totals* 

The analysis of the items related to the disjunctive geometric con- 
cepts Indicated that a significant three-way interaction existed between 
the strategy, exemplification approach, and intellectual ability factors* 

meanitigful interpretation was made for this interaction in terms of 
teaching* No other significant differences were noted for the geometric 
items and the factors under study* 

The analysis of the data corresponding to the students responses on 
Che exclusive disjunctive items also resulted in a significant three-way 
interaction* Agaln^ no meaningful interpretation was made for use in 
pedas^agical theory* Other Chan this significont interaction, no other 
differences were judged significant in this analysis of the data from the 
exclusive items* 

The final analysis of variance conducted on the data considered the 
student responses to the items involving the inclusive disjunctive 
concepts* Here both the strategy an'd exemplification approach factors had 
significant differences among their respective components, Scheff^'s test 
for Multiple Comparisons indicated that che CEC stracegy was more effec- 
tive than the ECE strategy. In addition, the test also indicated that as 
a group, the CEC and EC strategies were more effective than the CE and 
ECE strategies as a group* The example approach of the exemplification 
approach factor was significantly more effective in promoting student 
attainment of the inclusive concept:^ than the nonexample approach* 

The results of this study suggest sev^eral points of interest. Unlike 
Rector's study, several s^tatLstlcal differences were noted between the 
various strategy types and the exemplification approaches* These differences 
become more evident as orie moves up through the levels of the cognitive 
behavior taxonomy* The concepts Rector used were all conjunctive in form* 
Hence, the differences noted might be attributed to the fact the concepts 
in this stndy were disjunctive in nature. If so, the idea that the logic 
of the concept is the important factor to consider should be followed up 
by fucther research. 

Another factor which may have led to the differences was the change in 
the length of the strategies employed in the programed materials* In 
Rector*s stii'iy the strategies contained but five moves » while the strate* 
gies in Dossey*s study contained ten moves* Does the shifting of the 
length of the sttJtegy cause differences in the relative efficacy of the 
stratejiles? 

Another factor which may have caused a difference was the inclusion 
of the CEC strategy in Dossey's study* This strategy was not used in 
Rector*s work, and Che majority of che differences In Dossey's study were 
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related to this strategy. The common stCritegies for both studies showed 
little differences at the various levels of analyses. 

The strategy differences were significant at the Level II, Level III, 
and Total Test analyses. The nature of the CEC strategy and Its relation- 
ships to the tiature of a disjunctive concept may be the cause of the superi- 
ority of this strotef»y. It may be the case that the early Introduction of 
the identification move In the opening set of characterization moves In 
the CEC strategy fixes the concept for the student. The following sec of 
exemplification moves allows the student to focus on the manneC In which 
the dLsjuncts appear in the various e.\amples* The last two characterization 
moves allow the student to focus on the relevant characteristics and prop- 
erties that set off the particular disjunctive concept being studied* 

The ECE fonnat puts too ^nuch of a load on the student to initially 
Infer iUq relevant defining attributes of the concept at the outset. In 
closing, it does not provide enough examples (three) for the student to 
make full use of the information In the characterization moves in discri- 
minating between examples and nonexamples of the concepf . It also does not 
provide th« same type of closure the CEC strategy does* This closure of 
character izat inn moves may be mote important than the composition of the 
set of initial moves in tho strategy* In the analysis of the relative 
efficacy of the strategies for dealing with inclusive concepts, the CEC 
and strategies, those closing with sets of characterization moves 
were judged to be more effective as a group than those ending in exempll*- 
fl^ation movesi namely CE and ECE. 

The same statements apply to the CE strategy that applied to the ECE 
strategy. The EC strategy seemed to function fairly well in that it was 
always ranked second to the CEC strategy in term^ of effectiveness* Ics 
performance might be attributed to the larger span of time the stutlent had 
to infer, from the sequence of exemplification moves* the nature of the 
disjunctive concept. In addition. It had the closure section of a group 
of characterLzation moves* The fact that the order of the means tot the 
four strategies at alJ levels of analysis was tho same, namely ECE, CE, 
EC, CEC, moving from low to high suggests the Impott of closure with the 
characterization moves. 

The exempllf Lcation approach differences at both the Level 1 and Total 
Test showed that the predominance of example moves in a strategy was more 
efficnclnus than a predominance of nonexample moves* One might theorize 
that tho example moves were more important for the cognitive requirements 
of the items on the Level 1 exam than they were for the other levels of 
evaluation* The differences might also be explained by agreeing with 
Bruner's clainj that students have taot^ difficulty in dealing with non"- 
examples of a concept* 

The s LF^nlf leant' role played by the strategies in dealing with algebraic 
concepts^ while no significant differences were found in the relative 
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efflcacy of the stratef^y factor for the geometric concepts, might be due 
to the lack of visual ^Isments in the moves for algebraic concepts* 
Example inoves for geometric concepts usually involve a visual Image while 
the tlgebraic moves may or may not involve such a representation, Vurther 
research needs to be done to clarify this issue* Some combination of che 
present findings and Gintlter^s work might serve as a starting point* 

The findings on the comparison of the exclusive and Inclusive test 
itoni scores showed differences on both th^ strategy and exemplif IcaLlon 
factors for the inclusive concept items* The use of the exainple moves 
Ti, *y have been more effective here because these items can satisfy one or 
both of the defining conditions at once. The strategy factor differences 
might be attributed to Che closure moves of the CEC .and EC strategies. 
This closure set of moves may help the student overcome tlie confusion of 
the "and^' and "or" terms in relation to the nature of inclusive dis- 
junctive concepts. 

Halo's Study 

Two additional relative effjcacy studies have been carried out by 
educational researchers (Gaston & Kolb, 1973; Malo, 1974)- We shall 
examine the design and results of Haloes study first as it relates to 
both the Rollins and Dossey studies* 

Halo compared the relative efficacy of five exempliflcarion strategies 
to teach the twelve contrived disjunctive concepts used in Dossey*s 
study to a group of undergraduate students. In addition^ he prepared a 
programmed instruction unit which was to teach students bow to make use of 
the information contained in exemplification moves In the attainment of 
concepts. Some emphasis was placed on the use of nonexaiuples in this 
process * 

Malo's study made use of the levels of cognitive behavior developed 
by Rector to analyze the relative efficacy of the various strategies at 
different levels of intellectual functioning. He also administered the 
Kenmon ?^elson Tests of Hental Maturity to obtain a covariate measure to 
use in the analysis ^f the relative efficacy of Che strategies. 

Results of studies in psychological concept attainment (Hunt, 1962) 
and the results of the exemplification approach factor in Dossey*s (1971) 
study suggested to Malo the following five exemplification strategies 
(Halo, L974, p. 26)i 

1, Alternating Example and Konexample Strategy (EN )* This strategy 
consists of starting with an example and successively alternating six 
examples with six nonexampXes* 
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2. Alt&rtinClag Moaexample and Example Strategy (NTl ) , This strategy 
consists of gtarting with a nonexa'^nple and successively altGrn;3ting six 
nonexamples with six examples- 

3, Alternating Grouped Exanipleg and Nonexamplgs Strategy (6EM ) . 
This strategy consists of six examples followed by six nonexamples- 

A . Alten^atln^ Grovjped Won^^xamples and Examples Stj ; ate£jj^ (GNE ) , 
This strategy consists of six nonexatnpies followed by six examples* 

5. rtrou2.ed Exaraples Strategy (E ). This strategy consists oE twelve 
examples . 

Pro5?ranimQd instruiztional units were then developed to teach the 
twelve ^^oncepfes to the students in the sample^ The materials were care- 
fully <Jevelop\l to keep the Information contained in the moves balanced 
wlnh respect information about the disjuncts In the defining statements 
for the concepts. The materials were ^vhen given to students who were 
allowed to coir^plete them In class time. 

The desiija for Malo*s study is shown in Flgcre^b, The students in the 
groups marked with a tJ'* were the students who did not study the unit on 
leariiing disjunctives concepts from exemplification moves* The students 
In the groups marked with a "U'^ were the ones that used the experitnental 
units * 




Figure 6- The experimental desii^n used for Kalo's study. 



Ine analyses performt^d on the total test data showed that there were 
no significant difterences between the five different exemplification 
strategies in promoting student attainment cjf the disjunctive mathematical 
concepts, Malo conjectured th*it the absence of the differences might be 
a reiiult of the length of the strategies. Another possibility cited was 
the usage of programmed Instruction, It might be possible that the tise 
of tt^is instructional technique mighf: wipe out some differences that 
oUght hold with a teacher's tjse of the strategies. 

The analysis of the student responses for the different levels of 
cognitive behavior taxonomy revealed only one significant difference among the 
strategies. At Level 11 (application) the Grouped Examples Strategy was 
shown to be significantly better than the remaining strategies. This 
finding was consistent with flruner*3 findings (Bruner et al,, 1956). Wi^n 
the adjusted mean scores for the other strategies were examined, strategies 
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chac altcirnated examples with noneKamples fJeemed to have some advantage over 
Chose that grouped both the examples and the nonexamples. 

The analysis of the effects of^the eKperimental unit on learning frcmi 
exemplification moves showed that no significant difference could be 
attached to the use of the unit. The lack of a difference here may be 
due to several factors*. One is that the students already knew how to 
make use of such information* while another is that the strategy lengths 
might have destroyed any differences which resulted from the use or nontjse 
of the unit. A third explanation might be that the concept teaching 
strategies were so carefully constructed chat they caught the students in 
both groups the techniques for learning from examples. If this was che 
case* the ^differences due to the use of the experimental units would have 
been wiped out* 

Two other findings of Malo's study were similar to resulta nored in 
Dossey*s study. Exclusive disjunctive concepts were significantly easier 
for students to attain than inclusive disjunctive concepts. In addition! 
the geometric concepts were significantly easier for students to handle 
than were the algebraic disjunctive concepts. 

Gaston and Kolb's Study 

Gaston and Kolb (1973) compared the relative effectiveness of three 
strategies for teaching the concept of a partition of a set*. The study 
employed programmed Instructional materials to instruct a sample of under- 
graduate studerits about the concept*. Bidwell (1974) has commented that 
this study had some methodological problems; however, the design and 
factors chosen off.er some suggestions for further research. The following 
three strategies 

were nsed in this study : 

1* The first strategy was a four move CE strategy consisting of an 
identification move followed by two example moves with justification and 
then ^ third example move with instructions for the student to verify 
that the example truly was an example. 

2. The second strategy was an ECE strategy which opened with three 
example moves*. These moves were followed with six single characteristic 
moves which focused on the relevant defining conditions for a set partition* 
After the characteristic moves, the student was given the original three 
exemplification moves again and then four more new exemplification moves, 
three of which were examples and one of which was a nonexample. This 
refjulted in a strategy sixteen moves in length*. 

3. The third strategy was a thirty-eight move exemplification strategy 
consisting of moves which required the sttjdent to infer what a partition 
was and then discriminate between partitions and other subdivisions of a 
set. 
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To evaluate Che relative eEfecciveness of the thcee different strategies 
on student learning, three tests were given. The first was a VerticaX 
Transfer Test (Gagne, 1970). This test was aiaed at measuring the students* 
ability to transfer their knowledge about partitions from the examples and 
characteristics they had seen to ranking a list of generalizations concern- 
ing partitions as being soinetlmes, always, or never true. The tea item 
Vertical Transfer Test was followed by a thirty item test called the 
Exemplification Test, This second test required the subject to judge 
whether or not a particular set subdivision was or was not an example of 
a partition of a set. The third test, called' the Characterizatlori Test, 
consisted o£ fifteen statements which supposedly characterized the concept 
of a partition of a set. The student was then required to label the state-' 
ment given as being true or false, 

Ar^ analysis of the results of the study, while hampered by the small 
numbers and the inability to combine the scores from the two classes used^ 
suggested that there was no significant difference between the effectiveness 
of the strategies on either the Vertical Transfer or the Characterization 
Test, However, the results on the Exemplification Test when analyzed by 
orthogonal contrasts indicated that the mean of the E-strategy group was 
significantly greater than the pooled means of the CE and ECE groups. Ho 
significant difff>rence existed between the means of the CE and ECE groups. 

The concepL o^ a set partition is a conjunctive concept. Hence, the 
results from this study can be compared and contrasted to the results 
identified by Rector and by Rollins, Rector's findings suggested that the 
only differences occurred at the knowledge and comprehension level of 
evaluation. His results showed that the C-strategy was most effective at 
thi& Level, Gaston and Kolb's study did not have any test that measured 
cognitive activity at this level, and they did uot have a C-strategy» Gaston 
and Kolb found that an E-strategy was most effective on an Exemplification 
Test, This finding would compare with a finding at Rector's Level 11, but 
Rector did not have an E-strategy, Hettber study showed significant 
differences existing at the higher levels of cognitive behavior. 

In considering these studies, one is led to the conjecture that there 
may be some training effect betweeri the type oE strategy used and the type 
of evaluation used. Support for this conjecture is given by Rector*s C- 
strategy showing up well on the Level I test and Gaston and Kolb*s E-stracegy 
winning out on the Exemplification Test, 



85 




ERIC 



-78- 



Directions for Future Relative Efficacy Studies, 



in Mathematical Concept Teaching 



A_Rev^i^ of Known Results^ 

Comparisons airiong the foregoing studies may not be too accurate in 
that there were many differences in the nK>dels used.. A crucial difference 
was in Lhe lengths of the strategies employed, Rector'y strategies were five 
moves in lengthy Oossey*s were ten moves long^ Malo's were twelve tnoves 
longt and Gaston and Kolb*s ranged from four to thirty-eight moves In length.. 
Future studies should be careful to note the effects of different strategy 
lengths and the amount of time the subjects devote to the learning process » 
as these factors may have a significant effect on the efficacy of a parti- 
cular strategy. Some efforts should be made to keep the evaluation designs* 
or some aspect of them» s:^mllar enough to permit some form of comiparlson 
between studies. Such studies might also allow for further analyses of 
the questions considered before while offering partial replications of 
the prior studies , 

Future studies should attempt to take the following results of the. 
previously mentioned studies Into account in order that they may be 
considered again in both similar and different settings; 

1- Different logical forms of concepts may affect the relative 
efficacy of concept teaching strategies (Dossey» 1976).. 

2, Exemplification strategies do not differ significantly among 
themselves* but may be quite effective in preparing students to function 
with conjunctive concepts at the application level (Gaston fii Kolb» 1973; 
Halo, 1974; Rollins, 1966). 

3. Characterization strategies seem to be very effective in promoting 
student ^rihlevement of conjunctive concepts at the knowledge and compre^ 
henslon level (Rector* 1968), 

^, Differences exist in students* ability to handle algebraic aad 
geometric disjunctive concepts, as well as in their ability to deal with 
Inclusive and exclusive disjunctive concepts (Dossey, 1971; Malo* 1974), 

3, Strategies and exemplification approaches differ In their abilities 
to handle algebraic and Inclusive disjunctive concepts (Dossey, 1976)*. 

6. High ability students did significantly better than low ability 
students no matter what concept teaching strategy was employed. 
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These findings do answer several questions concerning the conditions 
tinder which various concept teaching strategies are effective* However, 
the/ still do not form a firm foundation for making pedagogical decisions 
concerning concept teaching. 



Shortcomings of rhe Relative Efficacy Studies Revlewed^ 

Several criticisms have b-een made concerning Ctie manner in which the 
foregoing studies have been . conducted. Swank (1973) suggests that the use 
of programmed Instruction limits the generallaablli ty of the results of 
th<s studies to any form of classroom t<saching. He also mentions that 
the strategies employed were too shorty l,e., they contained too few moves* 
Sowder (1974) questioned the use of coritrlv<sd concepts* such as were used 
in both Dossey*s and Malo*s studies* A later study (Sowder^ 1975) indi- 
cates that triere may be no real problems in projecting findings from 
studies using contriv<s<J concepts. 



The Use of the Findings of Relative Efficacy Studies 

With these limitations, the findings of these' tight ly controlled studies 
do provide Some directions for the mathematics educiitor*. The results sug^gest 
that .-some strategies may be more effective for developing certain types of 
concepts in writing textual materials^ programmed instruction units, or 
computer assisted instruction materials*. In addition, they provide some 
direction for determining the conditions under which classroom studies of 
the relative efficacy of various concept teaching strategies might find 
significant differences. Carefully designed studies of classroom teaching 
using different strategies might be carried out to attempt to replicate 
the studies which have been carried out via programmed instruction. Swank 
(1973) and Benjantin (1971) have carried out two studies comparing concept 
teaching strategies in regular classroom settings. 

In addition, the results of the controlled analyses of concept teach- 
ing strategies might be used in mlcroteachlng situations or in the develop" 
ment of protocol materials on concept teachings Such studies might also 
provide empirical findings which can be used to justify the study of 
concept teaching strategies In mathematics education texts, for example^ 
I>ynamlcs of Teaching Secondary School Mathematics (Cooney et ai* ^ 1975). 
Further, the findings may stimulate further studies on the relative efficacy 
of^^concept teaching strategies*. 



A Hodel for Further Research 

The design of future studies intght considec the following research « 
paradigm for concept teaching strategies*. This model is developed from 
the model proposed by Henderson (1970) and Turner (in this monograph)* 
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The model, pictured in Figure 7* draws its major dimensions from Turner's 
suggestions. The first diraenstoa consiscs ol tlxe variety of concepts 
considered in the (natheinatics curriculMtn Froni grades K-12. The various 
concepts might be listed individually or they might be divided into 
various Subdivisions according to various classificatory rules such as: 
general-vague » denotative-nondei^sOtative, algebraic -geometric , conjunc- 
tive^disjunc tive, or singular- general. 




The second dimension of the model, teacher actions, is concerned with 
various factors believed to be relevant to student acquisition of the 
concepts under study. Turner suggests Subdivisions along this dimension 
to consist of both strategies ^nd moves. A researcher most consider the 
impact of various strategy types on student learning, as well as the 
relative power of individual types of moves. The third dimension is the 
one that considers the variou§^ attributes possessed by students- These 
attributes are believed to be correlated with students' ability to attain 
the conceptual rtaterial of Interest. Such factors mi,;ht be achievement. 
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aptitude* or attitude scores from tests or othef sources of information* 
A fourth dimension which Ls not pictured in Figure 7 consists of various 
levels of indicators of student attainment of the concepts of interest. 
Such indicators might take the form of a taxonomy of levels of mathematical 
cognitive achievement , 



Topics Cor Further Investigation 

Some topics which need further investigation are; 

1, Contemporary tsxts could be sampled at the elementary and 
secondary levels to determine what strategies are being used. Such a 
study might go elong the directions laid out by Ginther, An interesting 
point would be Analysis of the algebra and geometry concept teaching stra- 
tegies employed by the same author in che cases where texts by the same 
author exist, 

2, The "power" of a single roove could be examined with respect to 
another move at the seme point* For exampJe, does an identification move 
and a necessary condition move have the same effect on student acquisi*- 
tton of a concept. Here strategies identical except for the one move 
would have to be used, 

3, Studies investigating the role t>f telling and the role of tjuestion- 
iog also fall into the realm of concept teaching strategies in mathematics* 

1'he ieugth of strategies and their relationship to student attain" 
ment of concepts is also another area of interest (Dossey^ 1975), If the 
design of this type of research calls for evaluation to take place within 
the strategy, the investigator must be careful to realize he is adding 
a move to the strategy at this point, 

5, More work needs to be done ii^ examining the role of example and 
noiiexample moves in concept teaching, Shumway (197^) has done work that 
provides insight in this area. Such studies must carefully balance the 
total amount of information conveyed in the strategies. 

The findings from such studies would, when combined with extant results, 
move us toward a theory of mathematical concept teaching which would begin 
to take on the characteristics suggested by Cage (1963) and Bruner (1966)* 
They would also provide the methods teacher with a set of generalisations 
conterning the teaching of mathematical concepts drawn Irom empirical 
studies of the relative efficacy of concept teaching strategies. 
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An Empirical Comparison of Teaching Strategies Whete the Amount 
of Content Information and Teacher-Pupil Interaction Is Varied^ 

Earl W, Swank 

Coastal Plains Cooperative Educational Services Agency 
Valdosta, Georgia 



Teacher talk is an Integral, if noc essential, aspect o£ teaching 
strategies (Hughes, 1963; Meux i Smith, 1964). Since teacher talk 
represents a sizable portion of the classroom dialogue it is jtistltiably 
the (concern of research* Certainly, as the teacher makes verbal contri- 
butions to the classroom dialogue, he is cominunicating information about 
coiuent* Gage (1972) wrote that the substantive content in the teacher- 
pupil interactions should have some impact on the learning that the 
students experience^ 

Research concerned with describing the substantive part of the 
teaching act has been carried out by Eellack (1965) attd Smith, Meux, 
CoombST Nuthail , and Precians (1967), A logical outgrowth of studies such 
as the two just mentioned is to manipulate the substantive aspect of the 
classroom dialogue in an experimental setting. The present study is an 
example of how the substantive content relative to selected mathematical 
concepts can be manlpulared in a simulated classrooPi setting and l^ow such 
manipulations affect student learning. 



Starement of Che Problem 



One puri>ose of this study was to determine if student achievement 
is sensitive to variations in the amount of content information* A 
second purpose was to investigate the effect of teacher*-puPii verbal 
interaction on student achievement* The amount of content information 
and the amount of teacher'-pupil verbal interdiction In establishing the 
content Information were ^regulared simultaneously so that possible 



This paper is based on a doctoral dissertation submitted to the 
Department of Mathematics Education, University of Georgia, in 1973, 
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Interactions of these two factors could be ascertained. A student ability ^ 
and treatnient interaction effect was made possible for investigation by 
randomly selecting students on two different ability levels for participa- 
tion In Che study> 

One variable under consideration i^as concerned with the amount of 
content information contained in the classroom discourse relative to a 
specific concept. The amount of content information that is transmitted 
by an instructional strategy can be described by the niimber of concept 
moves. Operationally, a concept move as described in Henderson's (1967) model 
for the teaching of ma themat Icri I concepts can be thought of as a unit of 
content information. Certainly, different types of concept moves provide 
different kinds of content information, but vlth careful limitations the 
number of concept moves can serve as an indicator of the amount of content 
inforniation contained in an instructional strategy. Emphasis for studying 
content information contained in the classroom discourse is provided by 
Cage (1972) who stated, ''By all that is plausible the logical and substan*" 
tlve content of the classroom content ought to have some connection with 
knowledge and comprehension students acquire'* (p. 313). A second variable 
was the amount of teach^^r-pupil verbal interactions in establishing the 
content information within the classroom discourse. As the concept moves 
are established In the classroom dialogue, there is some probability that 
the students will be cognltively involved. However^ it seems reasonable 
to assume that "the probability that students are cognltively involved is 
directly proportional; to the amount of overt participation^ (Snowt 1970, 
p. 25), Since verbal responses represent one category ^ vert partici- 
pation, the verbal r^^sponses can be used to indicate whei. students are * 
cogr^itiveiy Involved in the establishmeiit of a concept move. 

If the set of teacher-pupil verbal interactions is restricted to the 
verbal Interactions related to the establishment of concept moves » then 
" from a learning viewpoint it appears that the valtte of a concept move to 
a student is enhanced if the student contributes something to the ^-^ 
establishment of that concept move. Therefore^ the Ihdependent variable, 
concept move Interactloji . was defined to systematically control whe-Efher 
a concept move was a result of teache>; talk or a combination of teacher 
talk and student A classification system was developed to dlstin* 

guish three different types of concept move Interactions t^hat may occur 
and is given in Table 1. A method of describing distinct levels of con- - 
cept move interactions is provided by this classification system. 

An example is provided to illustrate the difference between categories 
1 and 2. If the teacher names a pairing of the members in two sets and 
then asks the students If this pairing is a function, some stuJetits may 
say "YeSt it is a function.'* If the teacher goes on to something else 
or follows the student response with a justification of why the pairing 
is a function^ the concept move interaction would be classified as a 
"1." However^ if the teacher had asked why it Is a function and the 
student gave the j ust If icatlon ^ the concept move interaction would be 
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classified as a ''2/' 

Table 1 

Concept Move Interaction Categories 



CatGgo ry 



Aaouot of Concept Move Interaction 



0 



The teacher completes the concept move in its 
entirety ♦ 



The toucher completes the concept rnove with a. 
short ircijponse from the student* 



2 



The teacher completes the concept move with 

either (1) two or more short responses or 

(2) a lengthy response by o"ne or more students* 



By operationally defining two levels for each of the two variables^ 
frequency of concejtt moves and concept move interac tiorj ^ it was possible 
to develop four instructional strategies* The four Instructional strate- 
gieSf denoted HH^ IIL^ LH* and LL* are described below: 

1* HH is an Instructional strategy employing a relatively high 
frequency of concept moves combined with a high amount of teacher-pupil 
verbal interaction in establishing the concept moves* 

2. KL is an Instructional strategy employing a relatively high 
frequency of concept moves combined with a low anwunt of teacher-pupil 
verbal Interdiction in establishing the concept moves* 

3* LK is an instructional strategy employing a relatively low 
frequency of concept moves combined with a high amount of teacher-pupil 
verbal interaction in establishing the concept moves* 

A* LL is an instructional strategy employing a relatively low 
Frequency of concept moves combined with a low amount of teacher-pupil 
verbal Interaction in establishing the concept moves* 
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Instiructlortal Strategies 



The two levels of concept move lateraction were defined In the 
following manner. A high concept move interaction strategy contained 
at least twice as many moves in the "2" classification as in the "0*' 
classification. Reversing this ratio of moves in the "0" and "2" 
classifications defined the low concept move interaction strategy. In 
both strategies the number of concept move interaccions classified as 
"1*^ were minimized. Tables 2A and 2B contain the number of concept OK>ves 
in each of the four strategies and the distribution of concept move inter- 
actions planned for each strategy. 

As the frequencies in Tables 2A and 2B indicate^ the number of con-^ 
cept moves in the high frequency concept move strategies (HH, HL) is 
approximately twice the number of concept moves in the low frequency 
concept move strategies (LH, LL) . Although there was a relatively large 
difference between the two frequencies of concept moves, there was no 
difference in the types of concept moves. To illustrate, consider 
one Particular type of concept move, say the "example'* concept move. 
There may be two examples of functions represented by an arrow diagram 
in tbe low frequency concept move strategy so the high frequency con^ 
cept move strategy would contain four examples of functions using the 
arrow diagram notation. Thus, the 2 to 1 ratio was preserved across 
each type of concept move for each of the three concepts taught — func- 
tion, inverse function, and constant function. 



Table 2A 

Planned Frequencies of Concept Move Interactions (High Frequency Strategy) 



HH Strategy 




HL 


Strategy 


Interaction 


Wuraber of 


Interaction 


tf umber of 


Categories 


Moves (N) 


Categories 


Moves (N) 


0 


N <^ 36 


0 


N _> 74 


i 


N _< 11 


1 


M _< 11 


2 


N >_ 74 


2 


M 36 


Total 


121 


Total 


121 
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Table 25 

Planned Frequencies of Concept Move Interacti'^ns (Low Frequency Strategy) 



LII Strategy LL Strategy 



Interaction 
Categories 


Number of 
Moves (to 


Interaction^ 
Categories 


Nun^ber of 
Moves (K) 


0 


K < lA 


0 


K > 36 


1 


K < 11 


1 


K < 11 


2 


K > 36 


2 


K < 14 


Total 


61 


Total 


61 



Deacriptlon of Tests 

An achievement test was constructed and field-tested In a pilot study 
prior to the implementation of the present study* An item analysis of the 
achleveioent test led to the elimination of those Items too eaay or too 
difficult or that had negative discrimination values* Another revision 
in the achievement test was accomplished by Including Items concerned vlth 
the composition of functions even though this concept was not included In 
the instructional strategies* The composition Items were introduced to pro- 
vide some measure of the relative transfer effect of each Instructional strategy* 

Each Item on the revised achievement test was classified by three 
judges according to the cognitive behavior required for a successful answer* 
Four cognitive levels based on Bloom's taxonomy were used for classifying 
each of the test Items* The four cognitive levels and the frequency of 
items at that level were; knowledge (6), comprehension (22) » application 
(25), and analysis (15)* The 68 test Items included 16 true-false^ 23 
multiple choice* and 29 completion-type questions* A parallel form of the 
achievement test was constructed by using equivalent Item .forms^ thus 
one form served as the posttest and the other as the retention test* The 
posttest was administered one day after the completion of the Instructional 
strategies, and the retention test was given one month later* There was no 
time restriction although everyone finished In less than one hour* 

Reliability coefficients were calculated for the posttest^ retention 
test» and the cognitive subtests using the Kuder^ Richards on formula 20 
(KR20>* Table 3 contains the calculated reliability values* 
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As indicated In the table, the reliability values for tha total tests 
were adequate vbile the knowledge and analysis subtests were less than 
desirable. These two subtests contained the fewest items (6 and 15 items 
respectively) and also the least variance. 



Table 3 
Reliability Coefficients 



Posttest Retention Test 



Total 


.77 


Total 


.77 


Know 1 edge Items 


-.02 


Knowledge 


.79 


Comprehension Items 


.65 


Comprehension 


.65 


Application Items 


.66 


Application Items 


.58 


Analysis Items 


.13 


Analysis Items 


.19 



Hypotheses 

The following null hypotheses were tested in the study. 

H.t There Is no difference between the mean performance of students 
experiencing the high frequency of concept moves and the mean performaiice 
of students experiencing the low frequency of concept moves on the post- 
test achievement measure. 

There is no difference between the mean performance of students 
experiencing the high level of concept move interaction and the mean per- 
formance of students experiencing the low level of concept move interaction 
on the posttest achievement measure. 

H : There is no difference between the mean performance of the 
ability level I students and the mean performance of the ability level 
II students on the posttest achievement measure. 

H^; There is no significant interaction of the frequency of concept 
moves and concept move Interaction on the posttest achievement measure. 

H.: There is no significant interaction of concept move interactions 
with student abilities on the posttest achievement measure. 
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H^; There is no significant interaction of frequency of concept 
moves with student ahiiitieg on the posttest achievement measure. 

H:^ There is no significant interaction of frequency of concept 
Tuoves , concept move LAteraction, and the student ability levels on the 
posttest achievement measure. 

Hypotheses Hg through H*^ were generated by replacing tne word "post- 
test*' in the seven hypotheses above with each of the following phrases; 

1. the knowledge items subtest of the posttesti 

2. the comprehension ittims subtest of the posttest, 

3. the application items subtesc of the posttest » and 

4. the analysis items subtest of the posttest. 

Hypotheses H-^ thro";gh H-^ were generated by using each of the 
retention measnies listed below the dependent variable in place of the 
posctest measure in hypotheses through H^i 

1. the rotal retention test measure. 

It the knowletis^ items subtest measure of the retention test^ 

3, the comprehension items subtest measure of the retention test, 

4, the application items subtest ineasuro of the retention test» and 

5t the analysis items subtest measure of the retention test* 

The null hypotheses listed above were tested to indicate which fat- 
tors or combinations of factors significantly affect student achievement 
as measured by a posttest and retention test* The treatment interaction 
hypotheses were of particular interest since the combining of treatments 
might nave an effect different than that expected from considering each 
treatment independently CVinerj 1962) . 



The subjects selected for participation were chosen from the eighth- 
grade class at Clarke Middle School in Athens, Georgia* Clarke Middle 
School is an integrated public school with appro xitnately 330 students 
in the eighth-grade from all socio-economic levels* 
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School records were used to obtain I.Q. rteasures ( California Test 
of >fental Matiirlty) which were then used to select students to pretest 
for possible participation in the study. Since average and above average 
students were desired for participation, it was arbitrarily determined 
to pretest only students with an I.Q. measure of 100 or higher.. 

Approximately 125 students were pretested to determine the selection 
of students for participation in one of the four Instructional strategies. 
The pretest ' items were partitioned into three subtests corresponding to 
the first three stages of Thomas' hierarchy (1975)^ which permitted the 
placement of each student at one of the three stages.. All students 
placed at stage two or higher were eliminated from further consideration 
for participation in the study.. After the eliminations were completed, 
the next procedure was to separate. the remaining students irvto two 
distinct ability groups on the basis of their I.Q.. measures.. This 
separation process was determined by the distribution of I.Q^ measures 
among the remaining students participating in the study. 

Ability level I students were defined to be students with an I.Q. 
measure of 100 to 105 inclusive.. Ability level II students were defined 
to be students with I..Q. measures of 111 to 125 inclusive. It was 
necessary to use a wider range of I.Q. measures for the ability level II 
students to obtain an adeqtiate number of sttidents.. 

The final selection procedure was to randomly select five students 
from the ability level I group and five from the ability level II group 
to form an instructional group.. This randomlzatiorv and stratification 
procedure was repeated until eight groups of ten students were selected. 
Each instructional strategy was then randomly asslgrved to two of the 
ei^t instructional groups. This procedure permitted the replication of 
each instructional strategy.. 



Analysis of Concept Moves and Concept Move Interactions 

To insure fidelity of the instructional strategies implemented to 
the planned instructional strategies, each instructional session was 
audio-" recorded and analyzed in terms of concept moves and concept move 
interactions. The analysis of the taped lessons allowed ^ comparison of 
the observed concept moves and concept move interactions with the planned 
concept moves and concept move Interactions.. Analysis of the taped 
lessons was done daily by the investigator to obtain daily feedback to 



A sequence of five stages was developed by Thomas to describe the 
development of the function concept.. For a complete description and 
discussion of the stages see Thomas (1975). 
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indicate the rigor with which each strategy was Implemented* 

A sequence of five twenty minuce lessons was eEtipIoyed to itnplenient 
each of the four Instructional strategies. The investigator was the 
only teacher implementing the four instructional strategies* Approximately 
two weeks were required for Implementation of the Instructional strategies 
and the administration of the postte^t* 

A comparison of the distribution of planned concept moves with the 
distribution of observed concept moves demonstrates thnt the Planned 
lessons were implemented. The distributions fot the planned and observed 
concept moves related to the three selected concepts'— functions, inverse 
function, and eonscarit function — for each Instructional strategy are 
given in Table 4* The data in fabler 4 indicate the number of observed 
moves is equal to or less than the planned moves. Some of the planned 
concept moves were stated improperly or not completed which resulted 
in the number of observed moves being slightly less than the number of 
planned concept moves. 

The taped lessons were also analyzed In Cetms of the concept move 
Interactions to determine how well the different concept move interaction 
strategies were implemented. The number of observed concept move Inter- 
actions and the number of planned concept move interactions for eaeh 
Instructional strategy are given In Table 5, 

The frequencies of the observed concept move interactions were in 
the desired direction compared to the frequencies of the planned concept 
move Interactions except for three instanees-'-lnteraction categories 1 
and 2 fot the HH| strategy and category 1 for the HH2 strategy. Despite the 
three disctepencies noted, the data Indicate that two distinct levels of 
concept move Interaction were implemented. 



Data Analysis 

The null hypotheses were tested using univariate analysis of 
variance (ANOVA) procedures. A three-way analysis of variance procedure 
was used on the posttest and retention test meaaures to test the equality 
of means across each of the variables — frequency of concept moves, 
concept move Interaction, and student abilities. The three-way ANOVA 
also permitted the three two-factor interactions and one three-factor 
interaction to be tested for significance, A three-factor experimental 
design with each factor fixed is referred to as a Model I design (Winer, 
1962, p. 172). 
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Table 4 

Distributions of Observed and Planned Concept Moves 



Concepts 




Function 


Inverse 


Function 


Constant 


Function 


Instructional 
Strategy^ 


Observed 


Planned 


Observed 


Planned 


Observed 


Planned 




87 


90 


23 


29 


13 


12 




87 


90 




29 


10 


12 




86 


90 


26 


29 


11 


12 


Lft 


ft7 


90 


t** 






12 


^1 


45 


45 


11 


13 


6 


7 




41 


45 


11 


13 


5 


7 


IL^ 


45 


45 


11 


13 


6 


7 


^2 


44 


45 


11 


13 


6 


7 



Each instructional strategy vas implemented twice* so HH indicates the frequency of moves 
observed In the first implementation and the frequency observed in the second Implementation. 



Table 5 ^ 
Observed and Planned Concept Move Interactions 



Interaction 

Categories 0 12 

Instructional 

Categories Observed Planned Observed. Pianned Observed Planned 





3i 


N 136 


20 


N 1 11 


11 


N > 74 


"«2 


21 


N <36 


26 


N 1 11 


76 


H> 74 




91 


N > 74 


IS 


N 111 


9 


N 136 


HL^ 


94 


N > 74 


S 


N 111 


8 


N 136 


LH^ 


13 


N 1 14 


10 


N 111 


38 


N > 36 


LM, 


9 


R 114 


10 


N 111 


34 


N ^36 


LL^ 


46 


N >36 


6 


N 111 


10 


Nl 14 




39 


N > 36 


S 


N <^11 


4 


N 114 
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Analysis of Variance Related to the Posctest 

The ANOVA using the total posttesc measure as Che dependent variable 
Is displayed In Table 6. ftone of the P ratios for the two-factor treat- 
ment Interactions or the one three-factor treatment Interaction reached 
significance at the .05 level. A significant F ratio was obtained on each 
of the three main effects — frequency of concept moves, concept move Inter- 
action, and student abilities. The inean on the posttest for students 
experiencing the high frequency of concept moves was 35.5 (total possible 
was 66) compared to ^ mean of 32.4 for the students experiencing the low 
frequency of concept moves. A similar romparison for the two means of 
students experiencing the high and low levels of concept move interaction 
resulted in 35.9 and 31.9 respectively • Thus, the higher frequency of 
concept moves and the higher level of concept move Interaction each facili- 
tated student achievement on the tot^l posttest administered the 
following the completion of the instructional strategies. 



Table 6 

ANOVA Using the Total Posttest 
Measure as the Dependent Variable 





Source 


df 


Mean Square 


F 


(A) 


Frequencies of 
Concept Moves 


1 


166. a34 


4.223* 


<B) 


Levels of Concept 
Move Interaction 


1 


311.911 


7.051* 


(C) 


Levels of Student 
Abilities 


L 


608,700 


13.760* 


A X B 




1 


.037 


.007 


A X C 




1 


117.085 


2.647 


fl X C 




1 


50 . 354 


1.138 


A X B 


X C 


1 


L.959 


.004 


Error 




69 


44.238 





*I> <.05. F{l,69> - 3.98 
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Tbe same avialysia q^ variance procedures were tised with each of 
the four cognitive subtests of the posttest as the dependent variable* 
The four ANOVAs for testing hypotheses 8-35 are summariied in Table 7* 
Significant main effects werr recorded on the comprehension subtest 
but viot on any other cognitive subtests* This finding may be attributed 
CO the content information contained In the instructional strategies* 
Many of the concept moves were directed toward identifying examples and 
nonexamples of functions* Also, many of the items on the comprehension 
subtest required students to Identify specific pairings as functions or 
nonfunctions* Hencej the instrno.tion seemed more closely related to 
these Items than any other subtest* Certainly this result supports the 
research hypotheses that more content information or more concept move 
interaction will increase student achievement* 

A significant Interaction was recorded in Table 7 on the application 
subtest between levels of concept move interaction and student ability 
levels* Hie B x C Interaction ia presented in Table 3 to demonstrate the 
interaction effect of student ability levels across the two levels of 
concept move interaction* An examination of the means in Table 8 indicated 
that the high level of concept move interaction facilitated student achieve- 
ment for the high ability students but not for the low ability students* 

Test items related to the composition of functions were included in 
the posttest even though the instructional strategies did not contain 
any Information related to this topic* The students' , performance on the 
composition of functions subtest can be interpreted ss a measure of trans- 
fer* Table 9 contains the ANOVA using the composition of functions 
subtest as the dependent variable* A significant ? ratio obtained in the 
analysis of the composition of functions subtest was attributed to the 
two levels of concept move interactions* In terms of an immediate trans*- 
fer measure, the performance of students was facilitated by the higher 
level of concept move Interactions on related concepts* 
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Summary of ANOVAs Using the Cognitive Subtests 
as the Dependent Variable 



Subtest 




Knowledge 


Comprehension 


Application 


Analysis 


Source 


df 


Mean Square 


F Mean Square F 


Mean Square F 


Mean Square F 



(A) Frequencies 
of Concept 





Moves 


1 


,007 


,006 


94.3^1 


9.839* 


2^,904 


2.291 


5,461 


1,031 


Cb) 


Levels of 
Concept Move 
Interaction 


1 


2.945 


2,2B5 


55.126 


5.749* 


27.393 


2,520 


4.281 


,808 


(c) 


Levels of 

Students 

Abilities 


1 


1.337 


1.037 


91.525 


9.546* 


151.725 


13.961* 


.171 


,032 


A X 


B 


1 


1.121 


,B70 


10.641 


1.110 


.811 


,075 


.237 


,045 


A 3C 


C 


1 


1.021 


,792 


21.8^5 


2.278 


15.170 


1,396 


4.1B1 


,769 


B 3C 


C 


1 


,033 


.026 


10,961 


1,143 


46,459 


4.275* 


2,660 


.502 


A 3C 


B 3C C 


1 


,705 


.547 


.171 


.018 


2.278 


,021 


1,602 


,302 


Error 


69 


1.289 




9,958 




10.868 




5.300 





^ t*^^* 1(1*69) =^ 3.9& 
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Table S 



B X C 


Interaction 


Table for the Application 




Subtest 


of the Posttest 






^1 


^2 


14.5 


10.0 




12,2 


10.9 



Note, 1^1 and represent the low and high 
levels of concept move interaction » respectively, 

and represent ability levela I and II, 
respectively. 



Table 9 

ANOVA Using Cotnposltlon of Fnnctlonfi 
Subtest as the Dependent Variable 





Source df 


Mean Square 


F 


(A) 


Frequencies of 
Concept Moves 1 


2,347 




(B) 


Levels of Concept 
Move Interaccion 1 


10,125 


4,289* 


(C) 


Levels of Student 
Abllitiea 1 


6,125 


2.594 


A X B 


1 


,125 


.053 


A X C 


1 


7.014 


2.972 


B X C 


1 


6.125 


2.595 


A X B 


X C 1 


,014 


,006 


Err^r 


64 


2,361 





*I>^ ,05, F(I,64> ^ 4,00 
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Analysis^f Var J ance Related to the Retencion Test 

The dependent variables for the ANOVAs ' testing hypotheses 36-70 were 
the total retention test mea^uire and each of the four cognitive subtests 
of the retention test. The ANOVA using the total retention test measure 
as the dependent variable and testing hypotheses is presented in 

Table 10, The only F ratio to reach significance was that of the classi- 
ficational variable — student ability levels. Approaching the critical 
F value of 3,98 was the three-factor treatment interaction with an F_ ratio 
of 3.69, 



Table 10 

AHOVA Using the Total Retention Test 
Measure as the Criterion 



Souice 



df 



Mean Square 



(a) Frequencies of 
Concept Moves 1 

(b) Levels of Concept 
Move Interaction 1 



(C) Levels, of Student 



Abilities 



A Jt B 
A X C 
B x C 
A jt B X C 
Error 



1 
1 
1 
1 
1 
70 



131,5^6 
119.469 

552,361 
^2,177 
96.096 
.778 

205,541 
52.795 



2,492 

2,263 

10,462* 
.799 

1,820 
.015 

3,893 



*^,> < ,05, P(l,70) = 3,98 
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the four cognitive subtest measures of the retention test were each 
used as a dependent variable in analyses of variance- These four ANOVAs 
are displayed in Table 11- Four significant F ratios were recorded in the . 
comprehension subtest AKOVA results — the three main effects and a two- 
factor interaction between frequencies of concept moves and student ability 
levels* The three'factor interaction effect using the application sub- 
test and the knowledge subtest as the dependent variables reached signi- 
ficance/ Another three-factor interaction effect approaching significance 
was recorded on the total retention caeasure - The only other significant 
F ratio in the four AMOVAs was produced by the student ability levels 
on the analysis subtest* Another main effect nqaring significance on the 
application subtest was due to the levels of concept move interaction* 

The three-factor interaction (A x B x C) results for the knowledge 
and application subtests are given in Table 12* A comparison of the 
effects due to the two experimental vf*rS.&bles across the two ability 
J(5^ci?i is permitted using the data prtisented in this table* 

A surprising result on both the knowledge and application subtests 
was found i^.i a comparison of the student ability group means within the 
low fre<iuencv of concept moves strategy — the A1B2 and ^i^i ceils of 
Table 12> It was surprising that there vras no difference between the 
two ability groups (Ci and C2> when experiencing the low frequency of 
concept moves combined with a high level of concept move interaction* 
However, the largest difference between the two ability grout^v? also 
occurred in the strategy containing a low frequency of concept moves — 
the LL instructional strategy, cell A^Bi* Not surprising was nhe con^ 
sistency across both tables of the highest and lowest means being 
recorded in the A2B2C2 and the AiBiCl cells respectively of both tables* 
In other words the presence of both factors* the HH strategy* was more 
facilltative in promoting student achievement than the absence of both 
factors, the LL strategy* Another pattern is revealed by a comparison 
of the means across the two student ability levels in the A2B1 and A1B2 
cells of both subtests* That is, the presence of just one main effect 
CA2 or B2) seems to be associated with little difference between the 
achievement of the two ability groups* 

The two-factor inttiraction A x C effect for the comprehension sub- 
test displayed in Table 13 ts of interest due to the significant F ratios 
obtained on the main effects, A comparison of the means for the high 
ability level students reveals little difference between the means for the 
high and low frequencies of concept moves. However, a sizeable difference 
occurs for the lower ability students between the high and low frequencies 
of concept moves- Thus* the additional content information had more impact 
on the achievement of low ability students than on the achievement of the 
high ability students* One could hypothesize that additional content 
information beyond a certain point may not be increasingly facilitative for 
students* However, as the data in TabJc^ 13 inditate^ this, point of dlmi.nishing 
. returns will be different for different ability levels* 

Stnte the retention test was a p:iTallel form of the posttest » it also 
contained the composition of functions subtest- Applying analysis of 
variance procedures to the composition of functions subtest revealed 
no significant F ratios. Thus, the facilitative transfer effect due to 
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Table 11 

Summary of ANOVAs Using the Cognitive Level 
Subtests AS the Dependent Variables 



Subtest 




Knowledge 




Co mp re he ns ion 


Application 


Analysis 






Source 




Mean Square 


F 


Mean Square F 


Mean Square 


r 


Mean Square 




F 


(A) Frequencies of 
Concept Moves 


1 


1.951 1 


.596 


oi.oiA 


5 .937* 


15 .472 


1 . 397 


3.378 




.941 


(B) Levels of Concept 
Move Interaction 


1 


.066 


t071 


45.917 


4.284* 


in 1 '\'\ 




6 .127 


1 


<: 

. 707 


<c) Levels of Student 
Abili ties 


1 




. U /i*^ 


-101.701 


9.489* 


37 . 388 


3.376 




c 


. JUU^ 


A K B 


1 


.135 


.111 


.674 


.063 


26.361 


2.380 


3.289 




.916 


A K C 


1 


.003 


.004 


47.593 


4.441* 


.890 


.060 


4.138 


1 


.152 


B K C 




.021 


.Old 


.715 


.063 


.391 


.035 


.265 




.074 


A X B X C 


1 


5.195 U 


.248* 


11.191 


1.044 


59.028 


5.330* 


1.059 




.295 


Error 


70 


1.223 




10.717 




11.074 




3.590 







*p < .05. FC1.70> = 3.98 



Table 12 

A X B X C Interaction Tables for the Knowledge Subtest 
and Application Subtest of the Retention Test 



Knowledge Subtest (6 items) Application Subtest (22 items) 







2 


h 






^1 






3.7 


3.2 




14.6 


12.4 




^=1 


3,2 


3,0 




11.5 


13,1 




^=2 


2,9 


3.3 


^=2 


13,3 


12,3 


*1 




2,9 


2.1 




13,2 


9,1 


Note, 


Aj^ and 


A^ represent 


the low and high frequencies of 


concept moves , 


respectively. 




and 


B2 represent 


the low and 


high levels of concept move interaction, respectively. 



C and C represent ability levels I and II, respectively. 



the levels of concept move Interactions found on the posttest was not 
present one month later* 

Table 13 

A X C Interaction Table for the Comprehension 
Subtest of the Retention Test 



A3 12*8 



A^ 12.5 8,7 



Note* A^ and A^ represent the low and high 
frequencies of concept moves, respectively. 

and represent ability levels I and II^ 
respectively* 



Discussion 



Conclusions Related to the Frequencies of Conce^ Moves 

The posttest data Indicated that the students receiving a high fre- 
quency concept move strategy achieved significantly more than did the 
students receiving a low frequency concept move strategy* This finding 
supports our Intuitive notion that there Is a direct relationship betvfeen 
the amount of content Information presented and the subsequent student 
learning. Somewhat disappointing was that the facilltatlve effect v^s 
not significant In the retention test results* An Interesting question 
Is suggested by the nature of mathematics and the results reported above 
— that Is, In mathematics the content Is sequential so If the. two fre- 
quencies of concept moves were continued over a long period <;f time would 
there be a widening between the means of the two groups? 

The posttest and retention test were partitioned Into four cognitive 
level subtests — knowledge^ comprehension, application^ and analysis, A 
significant effect due to the frequency of concept moves was recorded on 
only one subtest of the posttest — the comprehension Subtest* This finding 
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indicates that ndditional content information in the form of concept moves 
improved students' understanding of the content contained in the instruc- 
tional strategy*. While a significant effect wi\s also attributed to fre- 
^juency oc concept moves on the comprehension subtest of the retention test, 
there was a significant interaction between the frequency of concept moves 
and student ability levels that complicated conclusions based on this sig- 
nitlcant m*iin effect*. The interaction table for the frequency of concept 
moves X ability levels indic*ited that the high frequency of concept moves 
caused a substantival difference in student achievement for the ability 
level 1 students (lower ability students) but little difference in the 
achievement of the ability level tl students. An examination of the 
group means of the low ability students indicated that the high frequency 
of oncept moves facilitated the retention of content more than the low 
frequency of concept moves. The facilltative effect due to the high 
fiequency of concept moves on the comprehension measure was not present 
in a comparison of the means of the high and low frequency concept move 
strategies using ability level It students. Thus, it appears that the 
high frequency of concept moves was more effective in the retention of 
conuent for the ability level 1 students than for the ability level It 
students. 



Conclusions Related to the Levels of Concept Hove Interaction 

On the posttest the moan performance of the high level concept 
move interaction group was significantly greater than that of the low 
level concept move interaction group. This result confirms the belief 
held by many teachers and educators that student achievement is enhanced 
by student participation. However, the facllltative effect due to the 
high level concept move interaction strategy was not present in the 
total retention test results. 

The comprehension subtest produced the only contrast of group means 
that was statistically significant on the cognitive level subtests of 
the posttest. One month later* on the retention test, the facllltative 
effects due to the high concept move interaction strategy was still signi- 
ficant on the comprehension subtest. Significant differences occurring 
on the comprehension subtest of the posttest and the retention test 
suggests that understanding and retention was greater for the students 
receiving the high level concept move interaction strategy than for the 
students receiving the low level concept move interaction strategy*. 

A significant interaction between the levels of concept move inter* 
action and student ability levels occurred in the applications subtest of 
the posttest. The high level of concept move interaction facilitated 
achievement on the application subtest for the ability level II students, 
but for the ability level I students there was little difference in 
achievement on the application between the two concept move Interaction 
groups. One explanation why the high level of concept move interaction 
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improved achievement for ability level 11 students but not for the ability 
level T students depends on the student reactions to verbal participa- 
tion. That ist the ability level I students may view the verbal inter- 
actions as threatening'* and become anxious about verbally participating^ 
and this interferes with the learning process* The ability level 11 
students were ^ot anxious about the verbal interactions and were able 
to profit more from the teacher-pupil verbal interactions, 

A significant three-"factor Inct.raction occurred on the knowledge 
and application subtests the retention test. In both cases, the 
greatest mean performance was by the ability level TI group receiving 
the high frequency of concept moves strategy and the high level of con^ 
cept move verbal interaction* A consistent finding for both subtests was 
chat the lowest mean performance was by those ability level I students 
who participated In the low frequency of concept moves and low concept 
move interaction strategy* 

An interesting result Is found in both interaction tables when the 
two ability level group means are compared across the four cells where 
either the high frequency of concept moves strategy or the high level 
of concept move Interaction strategy CHL and LH)t but not both^ was 
employed* There seems to be no difference between the ability level 
I and 11 groups when experiencing either the high frequency of concept 
Moves or the high level of concept move Interaction* Disregarding 
the two ability levels, there seems to be little difference between the 
achievement of the KL and LH groups — chat is, the high frequency of 
concept moves combined with the low level of concept move interactions 
(HI*) and the low frequency of concept moves combined with the high 
level of concept move interaction (LH) , One consistent and not un- 
expected finding in the knowledge and application interaction tables was 
that the tlH strategy faclLitatetl student achievement more than the LL 
strategy* 



Implications for the Classroom 

The final objective of research dealing with teaching strategies 
is to construct a theory which will guide the classroom teacher^s 
behavior. The present study was an experiment to demonstrate that the 
amount of content information is under the teacher's control and Is a 
significant factor affecting student achievement* However, a statistical 
significance does not automatically Insure an educational significance, 
A comparison of the means of the high and low frequency concept move 
groups reveals a difference of 5S which is of questionable educational 
significance, Itowever* a comparison of the same means for the compre- 
hension subtest of the posttest and retention test indicates differences 
of 10% and 87* respectively* Certainly as the differences between teach- 
ing; strategies approach 10% or higher, thev become educationally signifi-^ 
cnnt* An examination of the interaction tables for the application and 
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knowledge subtests of the retention test revealed differences in means 
between the KH and LL groups of 10% and 26% , respectively. Thus» In this 
limited example the HH strategy was educationally significant. 

It Is improper* from Che results obtained in this Investigation » to 
make ati overall generallzai ton concerning che effects of a relatively 
high amount of ceacher^popil verbiil interaction on student athlevement. 
Certainly when significant differences due. to the teacher-pupil Interaction 
occurcedf they favored the high level of concept move interactions. But 
an inspection of the significant treatment interaction tables revealed 
that chls Ending was not consistent across both ability levels and concept 
move levels. Thus, as a theory of Instruction is established. It may pre- 
scribe different amounts of teacher-pupil verbal Interaction for students 
o£ differing abilities. 

A great deal of research has been directed towards comparing two 
extremes of pupil participation In tbe classroim dialogue. However* tbe 
results of this research are not conclusive — that is, it has not been 
clearly demonstrated that one extreme of teacher-pupil InterscClon is 
^iny better than the other extreme. Research has attempted to justify 
the use of more teacber-pupll verbal Interaction on the basis of In- 
cr£:asing student achievement^ but tbe contradictory findings i^ tbe 
research literature do not permit tbls generalization. Perbaps the 
jusrlf Ication for more teacher-pupil verbal interaction will be based on 
something besides student performance on an achievement test. 



Recommendations For Further jes^arch 



The literature is replete with statements confirming the non- 
existence of a theory of instruction (Begle, 1973; Dodes* 1953; Gage, 
1963). Although these statements, spanning the last two decades* indi~ 
cate chat the desired goal has not been attained, tbere has been progress. 
One area of progress has been concerned with the observation* recording* 
and/or describing of teachers' behavior in the classroom (Fey, 1969). 
flarr (I96l) observed that there has been a shifting of emphasis from 
qualities of teachers to behaviors of teachers. The shift of emphasis 
was Important because it is only through the use of reliable observational 
schemes that the behaviors of teachers can be manipulated and studied witb 
controls similar Co what might be expected In a laboratory setting* 
Hlllway (1969) writes that the classroom may be made into a "de facto 
laboratory" If there are controls placed on the basic factors under con- 
sideration. Rosenshine and Purst (1973) echo the call for more researcb 
in classroom settings wbere the teaching act Is monirored to insure 
fidelity to tbe treatment under Investigation, 

A desirable outgrowth of Che proliferation of schemes for observing 
and describing the behavior of teachers Is the Increased variety of 
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teaching of roncepts* Second, the research literature teveals that there 
is a paucity of studies investigating how the cognitive aspects of the 
classroom dialogue are related to student learning* Some examples of 
the constructs available for investigating the cognitive aspects of 
teaching strategies are: 

(a) ventures, episodes, and monologues (Smith et al* » 1967); 

(b) deductive i inductive, classifying, and analy^ins 
categories (Cooney & Henderson, 1972); and 

(c) substiintive-logical meaning processes (Bellack, Kliebard, 
Hyman , & Smith 1066) . 

Another consideration in the description of a teaching strategy is 
related to the type of content contained in the strategy* Cooney, Davis, 
and Henderson (1975) describe three t^^pes of knowledge, concepts, gen- 
eralizations > and skills, each of which may be used as the focus of a 
teaching strategy. Cooney et al. have developed a taxonomy of moves for 
the teaching of generalisations. Tliey also discuss how the generalization 
muves can be used to differentiate between a guided discovery strategy 
and an expository strategy. In addition to studying teaching strategies 
where the number or sequence of moves for the teaching of generalizations 
is manipulated, it may prove fruitful to investigate combinations of 
generalization moves and concept moves* Concepts form a necessary part 
of generalisations, yet the study of teaching strategies containing both 
types of moves represents an unexplored approach* 

It would be Interesting to compare the relative Importance that 
teachers place on teaching each of these types of knowledge. All three 
types — concepts, generalizations, and skills — are Important. Teaching 
Strategies with different objectives (e.g., attainment of concepts, 
application of generalisations, or Improvement of skills) must be 
defined and Investigated to determine how a teacher should behave 
relative to each type of objective* 
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Design Problems In Research 
on Tefiching Strategies 
in 

tta thematics 
Richard L, Turner 
Indiana University 



'Vhl^ paper focuses on two sets of design problems In research on 
teaching strategies in mathematics, grades L-12. The first set involves 
the definition and organization of domains of variables believed to be 
relevant to mathematice instruction, so that samples of variables drawn 
from these domains yield as much information as possible about them. The 
second set of problems involves the practical matter of relating multiple 
classes of variables to each other in such a way that reasonable inferences 
about their relationships can be drawn^ 

Relative to these points, a critical consideration is that the 
various investigations conducted in this research domain yield evidence 
which may be systematically Incorporated into arguments about the true 
relatlof^shlps in It. For eitamPle, the central claim inherent in the 
taxonomical work on teaching by Smith, Meux, Coombs, Nuthall, and Precians 
(1967), Henderson (1972), and Cooney (1974), Is that the "moves" -lade by 
teachers, and the order of these moves ("strategies"), will ultimately 
be found to have a significant bearing on the acquisition of mathematics 
concepts, principles, and skills among students* No single piece of 
research, experimental or otherwise, will prove or disprove the arguments 
surrounding this claim* A set of properly conceived investigations should, 
however, yield evidence that the clolm is or is not empirically valid. 
If it is not valid, this evidence should suggest alternative arguments 
which seem best to account for the relationships found in the domain. The 
point to be made is that the results of individual research projects 
focused on teaching strategies are not ends in themselves. Rather the 
projects are used to support arguments about the true composition of the 
domain, and through these arguments they actaif» a generality far beyond 
that attainable within any Individual investigation*. 



Defining and Sampling the Relevant Domains 



The first step In a properly conceived research design is to 
Identify the domains of variables to be covered in the design*. There 
are four such domnlns in research on teaching strategies in mathematics*. 
The first is the subfjtantive domain of mathematics as taught In elementary 
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and SGcondfity school. According to Menderyon* this doioain divided 
into sets to include concepts* principleSj and skills, Tlie sets may be 
Eurthcr divided into subitets or classes. The second domain is comprised 
of teacher actions and intera<:tions believed to be relevant to the 
acquisition by students oE the substance of the first domain- The rele- 
vant doiTitjin of teacher action has two sets in it; "moves" and "strategies*' 
(combinations o£ moves). Each of these sets* according; to both Smith 
et al- (1967) and Henderson (L972)* may bo furthet sitbdlvid^id , The third 
relevant domain is comprised of student attributes which, in addition to 
the actions of the teacher* ate believed to be correlated with the ^icqoisl- 
L ton of mathematics concepts, principles* and skills- There are numerous 
classes of stodent attributes* but not all are equally salient In the 
acquisition of mathematics content- The fourth relevant domain ig com- 
prised of chose performances by students which are taken as indicators 
that particular concepts* principles, or skilla in mathematics have been 
acquired- As i^ the other domains* the set of all indicators of mathema- 
tics attainment can be divided into subsets, with each resulting set theore- 
tically polnt^ne; to different levels of and/or different typOiS of mathematics 
at ta I nmen t- 

In addition to the four domains of variables noted above* a fifth 
domain which niay be labeled "setting variables" may be also recognised 
as generally pertinent to research on teaching- Thjs domain is interpreted 
here to include the type of school organization and "climate^' in which a 
person teaches, the attitudes of the community toward schooling, the types 
of materials provided for Instruction* and the like- For present purposes 
the variables in this domain will be treated ^s "given=t'' and will be taken 
into account only in a very general way (for example, in extracting between"- 
school or between"discrlct variance in the event a Particolar investigation 
is subject to error through the intrusion of variables from this ^*setting'* 
domain) - 

As noted above, each of the domains is composed of subsets or classes 
of variables- For example, mathematics concepts and skills are viewed as 
different classes of variables, and so are moves and strategies, even 
though strategies are comprised of combinations of moves- More generally, 
if one concepCualiKed the domains as dimensions* each dimension may be 
further tonceptuali^ed as having an array of classes along it- There are 
thus four arrays of classes of variables- Within each dimension, the 
ciasses of variables hold either analytic <or definitional) relationships, 
or else empirical correlative relationships, to each other- The relatlon- 
ships between dimensions* on the other hand, are ^11 ordered conditional 
ones- These relationships may be expressed in general hypothetical form 
as follows; If student attribute A is divided into levels Lit---tLnt and 
If conr(?pc C is to be caught (la the teachable object), then teaching 
strategies Sj, S2* ^2 produce student outtomes (), such that for all 

indicators of 0* * I2' - " »In* Ij^ ^ leveJ« * L^* - - - ^L^ 

of A- ^ ^ 
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Btiried witKin this generalized proposition are two itnporcant tasks 
to be performed by researchers who wish to make empirical tescs of the 
proposition cast la specific JfornK i*e*, when actual variables are sub* 
stituted for the general terms. Ttie first of these tasks is to attempt 
to represent in each specific term chosen as many eleinents of the class 
to which it belongj as possible. Thus, each specific variable or element 
selected may be viewed as a spriiple of a class or set to which generali- 
zation might be made. The second task is to increase the potential pre-^ 
ciSiion of the experiment, quasi^exp^T-iment , or survey to the greatest 
de^'.ree. The reason for attending to precision is that the power of a 
stf;clfic teaching move or strat^^^^y i^^^ nnjver c<^rtain. One thus wishes to 
opLimi:;e, Insofar as he can* the chance,^ that the true resolts will appear 
by systemacicaliy taking out known sourcts of variation i-f^ the outcomes 
sought. The importance of these two tasks varies with each of the four 
domains under consideration, thus each cask needs to be examined rela- 
tive to each domain, 

Dom<>in 1, ^fathematics Concepts, Principlest and Skills 

A mtijor portion of the work done by Henderson (l970t 1972) and 
presented by Cooney (197i) has been to develoP a taxonomy of teachable 
objects in mathematics. The structure and components of this taxonomy 
are summari£;ed 1:^ Figure 1 and some sVmbols added to them. 

As may be noted in Figure each class of the taxonomy has many 
elements in it. For example* the class of denotative concrete singular 
concepts (Dcs) has in it all such concepts in mathematics grades 1-12^ 
or DCS concepts, where n must be a very large nomber- The same must be 
true o? the other classes in the taxonomy, excluding nondenotative con- 
cepts ('v D) , which is regarded as mathematically uninteresting- 

From the viewpoint of the researcher* the existence of large classes 
of teachable objects of unknown heterogeneity poses a substantial problem. 
To avoid conducting an indefinite number of experiments involving every 
conceivable teachable object, he must select for each experiment those 
teafhnble objects from which generalization can be to the members of 

the homogeneous class to which the object chosen belongs. The problem ig 
to Increase the probability that tbe classed of teachable objects are 
homojGieneous before conducting the experiment. The Henderson taxonomy does 
not address this problem, but it should nonetheless be dealt with zo enable 
systematic research to occur in this field. Following are soTie steps that 
might be taken to resolve this problem- 

First* beginning with the classes already existing in the Henderson 
taxonomy, each class shot^id be stratified according to the general grade 
level (or d(?veiopmental level in mathematics) which eath particular 
concept, principle, or skill is typically taught. Thus* the singular 
concrete denotative coi^cepts in class Dcs would be ordered to perhaps six 
strata or levels. Second, within each stracum* the conc<iptSt principles. 
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Figure 1, A representation of the ta^totiomy of teachable objects in mathematics^ 
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or skills should be redivided according to hov easy or difficult they are 
for students to learn Ci-e,* for teachers to teach successfully). The 
reasons for taking these steps are; First, mathematics content is already 
graded so that: an ordered series of concepts^ principles, and skills 
appear in it, and any experitnent is almost certain to be done within a 
particular level of this series, Secondj the eaf^e-c^i f ficulty of a teach^ 
able object is correlated (but imperfectly so) to its placement in the 
aeries* Third* separating teachable ob^iGcts according to ease-difficulty 
makes possible the selection of the more difficult objects for the experi* 
ment to be conductedi Selecting difficult concepts* principles* or 
skills is desirable because '*easy*' ones are by definition those that can 
be learned about equally well under any teaching strategy- Thus* the power 
or superiority of one strategy versus another would not be expected to 
appear unless ''difficult learnings" ace involved in the experiment. 
Although these first two steps seem fonnidable* the information on which 
they are based should already be available in the literature of mathematics 
education and should be easy to retrieve, 

A third step in creating more homogeneous classes of teachable objects 
seems more difficult than the other two. It i:eqviires the identification 
of substantively related families of concepts, principles* or skills across 
the series of strata developed in mathematics content in step 1, These 
families* for example* might be comprised of concepts with coTrarion elenients 
such as common fractions, proportions, decimals, and percents. If such 
families do exist extensively in mathematics* identification of them and 
stratification according to them is important insofar as one would expect 
teaching strategies successful in attaining superior outcomes in one 
branch of the family to have better than random probability of generalizing 
to other branches of the family. 

If the three steps described above were to be taken in the domain of 
teachable objects, the result would be a set of sampling frames within 
each subdomain of conceptSt principles* and skills. For example, in 
the domain of concepts, and in the set of denotative concepts^ a minimum 
of 12 sampling frames might be foreseen: six strata or developmental levels 
of concepts and within each* twa levels easy and difficult. Finally* an 
additional stratification by families of substantively related concepts 
might be possible* It seems likely, however* that stratification by 
these families Is not perfectly replicated or balanced across all the 
twelve frames, so that some imbalance would result^ i,e,* not all families 
can be represented in all frames* 

Once these frames are developed, the stage is set for sampling from 
them. The exact method of drawing the sample is, however* a practical 
matter of research design and is discussed in Section TI, 

Domain 2. Student Attributes 

The reasons for attending to student attributes in research designs 
involving teaching strategies are quite different than those for develop- 
ing sampling frames and more homogeneous classes in the universe of 




ERIC 



-L20- 



teachable objects in mathematics* Student attributes are employed* on 
the ons hand^ to increase the statistical precision of the design, and 
on the other, to provide the possibility of obtaining greater information 
about the effects of particular teaching strategies on different types 
of students. Increases in the precision of designs come about by extrac- 
ting from the variance of the indicators (I^j I^j^.^^l^) of the student 
learning outcomes Chose portions which are attributable to the antece- 
dently measured attributes of the students. This helps to tninlmiEe the 
residual or error variance. By minimizing the error variance, the pro^ 
bahillty of showing ^;ft'ects for teaching strategies may be Increased. 

A general design strategy which seeks to increase precision also may 
be employed frequently to increase the amount of inforniation extracted 
from the research^ depending on the specific design ttsed* In designs 
employing analysis of covariance^ randomized blocks (matched-randomized)* 
or residual gains analysis^ the variance attributable to the antecertdently 
measured student attribate(s) Is usually discarded as uninteresting, l^e** 
no specific Information is extracted from it* In stratified designs^ on 
the other h£^J, about the same level of precision can be attained, but 
the otherwlSti discarded variance can be assigned to levels of a student 
antecedent attribute (L^* L^, * * . of A), so that effects of the 
various teaching sttfltegies on dif?erent types of levels of students may 
be extracted from the design* Thus, che information available from the 
design is potentially Increased. 

The practical problem confronted by the researcher is not simply 
which type of design to use* but more importantly, which student 
attribute(s) to assess as the antecedent*. In research on teaching 
strategies, one important criterion to use in the selection of this 
attribute is that measures of it be readily available. If they are not, 
and different levels of the attribute are subsequently shown to relate 
to different types of teaching strategies* teachers will be unable to act 
on this information since they will be unable to stratify their students 
and differentiate strategies for students In these strata*. A second 
important criterion for attribute selection is the expected correlation 
between the antecedent measures and the learning outcome measures* If 
this correlation is low, little gfiln in precision will occur, and, unless 
there are interaction effects between the levels of the antecedent 
measures and the outcome measures » little will be gained from introducing 
the attribute into the design* 

The student attributes which best fit these criteria are, theoreti- 
cally, specific aptitudes for learning mathematics in its various branches*. 
Quantitative estimates or measures of these aptitudes can be generated 
either on the basis of the P<ist performance of the student in that branch 
(e.g., arithmetic, algebra, lEfeometry) or by a cesc which covers con- 
cepts, principles* or skills which the student would be expected to have 
learned. The notion that other attributes of students such as attitudes 
toward mathematics or personality characteristics should be employed in 
research designs involving teaching strategies Is probably unsound. The 
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influence of Such variables on mathematics learning is not well estab-^ 
lished. Moreover, any significant influence from these sources would 
be Incorporated into the variance of aptitudinal measures since the 
latter would reflect any set of attributes consistently correlated with 
previous attainment in mathematics* 



Domain 3* Teaching Moves and Strategies 

This domain confronts the researcher with a critical choice at the 
very outset* This choice is between doing experiments which test, as 
the experimental treatments, selected teaching strategies versus teach^ 
ing preservice or Inservlce teachers the relevant array of moves for each 
type of teachable object, then letting them develop the teaching strate- 
gies as they see fit* Up to this writing, the experiments conducted have 
chosen the first of the two alternatives. A good case can be tnade, how- 
ei/er chat this alternative has distinct difficulties associated with It*. 

First, a sttategy is a combination of moves*. £o say that it Is 
a "temporal sequence of moves*' does not add Infotmation since two or more 
moves cannot occur simultaneously* Viewed as a combination of moves. It 
is Intuitively clear that there are in_ej<cess of n factorial strategies 
available for each set of n relevant moves, since a move may be repeated 
in a strategy*. For estample, there are six rj^levant moves available for 
teaching denotative concepts. Since two or pjore moves must occur In 
sequence for a strategy to occur, and since each strategy has a fixed 
order of moves, th&re are at least 6! stratesles for teaching denotative 
concepts. Since moves can be repeated, there are of course a great many 
more than 6S strategies possible. Given the fact that different sets of 
moves are available for teaching concepts, principles, and skills, it is 
quite clear that the number of strategies that might be experimented with 
is very great* 

The difficulty confronted by the researcher is, of course, to select 
from among the possible strategies that one or that set with which he 
wishes to experiment* Hypo thetically , the researcher needs both to select 
tlie most powerful strategy for teaching a given concept and to be able to 
generali?.e from the strategy he has chosen to some subset of similar 
strategies* The procedures he is to use to make these choices, other 
than trial and error, are not at present altogether clear* In existing 
research, the choices appear to be made intuitively and left unexplained* 

A second difficulty with a research approach which tests the efficacy 
of particular sttSttegles lies in the utility of the outcomes for teachers. 
To see chis difficulty one must first bold in mind that thete is an n- 
dimenslonal matrix of teaching strategies for concepts, principles, and 
skills*, and thete Is also an n-dimensional matrix of teachable objects. 
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If different strategies are nee<led to teach the different classes of 
teachable objetts (the subclasses of concepts, principles, and skills), 
the total number of strategies ^ teacher would nee^I to learn and be able 
to use would create a skill acquisition and memory load of immense 
magnitude — one probably impossible to deal with* 

Although these difficulties are perhaps not insurmountable, they do 
suggest that an alternative kind of research on teaching moves and strate^ 
gles might be undertaken* In simplest terms, the alternative research 
strategy is to train teachers to become skillful in making specific 
teaching moves and to familiarise them with the concept of teaching stra- 
teglesv but not to attempt to train Chem on specific strategies* Rather, 
each teachtsr would be left to generate strategies situationally * Aside 
from the fact that this approach reduces the memory load for the teacher* 
an important reason for considering it lies in the distinct possibility 
that the course of moves s strategy actually depends on the feedback 
the teacher is receiving from students* Indeed, the original work by 
Smith et al* (1967) and Smith and Meux (1970) derives teaching utoves as 
monadic units of teacher behavior out of dyadic (or interdependent* 
response-contingent) teacher-pupil classroom behavior* In this work, a 
strategy was a series of maneuvers on the part of a teacher toward a 
particular teaching goal* These maneuvers were not completely indepen- 
dent of what the participating students did- Rather, the course of the 
moves depended to some degree, but not entirely, on how one or more 
students responded to each successive move. 

If the notion that student response following s move is incorporated 
as a necessary attribute into the concept of teaching strategies, the 
definition of the latter changes snd becomes dyadic as follows: 

A te<iching strategy is a combinstion of tnoves the exact 
course of which depends on the response of the student (s) 
following each move which solicits a response from students, 
(dyadic definition) 

This is in contrast to: 

A teaching strategy is a combination of moves, (monadic definition) 

Th^ difference between these two definitions from the researcher's 
viewpoint is that the monadic definition points the stream of research 
toward programmed instruction or *'progrsmmed teachers" in which the 
order of moves in a strategy is fixed* It is notsble that Nuthall's 
dissertation (1967), the first empirical research in this area, used 
programmed materials as the treatments and apparently greatly influenced 
the course of subsequent research. The alternative stream of research, 
that based on the dyadic definition of a strategy was, however, never 
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developed^ or if developed^ never published. The writer suggests that 
it be developed as the alternative main stream of research on teaching 
moves and strategies* The two main streams of researchj one based on 
the toofiadic definition and the other on the dyadic definition are out- 
lined below. 

Research based on a monadic concept of teaching strategies . As indi- 
cated in earlier paragraphs^ a central problem in research in this stream 
Is how to sample strategies. This sampling should be done in such a way 
that those strategies selected are? (a) potentially the most powerful 
ones, (b) represent a class of similar strategies, and (c) are sufficiently 
few> or are sufficiently easily learned^ to be incorporated into the skills 
of teachers without creating a cognitive overload. 

One way to approach this sampling problem is to begin not with the 
strategies themselves^ but with an assumption about the manner in which 
teachers hold or remember pedagogical knowledge. This assumption is that 
teachers adopt approaches to or models of teaching under which they then 
subsume clusters of knowledges and skills. This assumption seems implicit 
in Henderson's taxonomy (1970) and is used by Cooney (1974> p. 161) and by 
Lester (1974) In discussing the skills of mathematics teachers. Under ity 
approaches varying from highly didactic or "deductive" such as exposition 
or rule-example through advanced organizer (analogy) » guided discovery^ 
and discovery or "inductive" approaches are selected as the first step. 
Second^ strategies are grouped under these approaches according to 
the degree to which they exemplify the approach and the extent to 
which they are suggested by or supported by the research literature* For 
example^ the '*ruleg'* or rule-example approach Is exemplified by strategies 
which open with one or more connotatlve moves followed by denotative moves. 
With respect to the denotative moves^ some of c^e recent literature on 
concept learning (Markle & Tieman, 1971; Thiagarajan> 1971) suggests that 
whether or not the extended examples and nonexamples given are matched or 
not matched to those initially given is an important aspect of learning 
and retaining concepts under a "rule-example" approach* 

The third step is to group the strategies according to the number of 
moves which must be made clear in order to give the student extensive 
information about the concepts principle^ or skill. Hypothe tically » 
the most powerful strategies will be those that provide the most informa- 
tion in the fewest moves. This hypothesis might be false, however, so 
that sampling strategies from different groups ordered according to the 
information given per move is aa important consideration in actually con- 
ducting an experiment. 

The intent of these three steps Is to organize each domain of strate- 
gies into sampling frames* From these sampling frames^ the most promising 
strategies can then be sampled for experimental work and^ if found 
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promising, for teaching to teachers* 

Research based otx a dyadic coacept of teaching strategies . The 
general objective of this stream of research is to determine whether or 
not teachers trained to make selected teaching moves smoothly and accu^ 
rately obtain^ under experimental conditlonSt better learning outcomes 
from students than teachers not thus trained* A key factor in this 
stream is the selection of those moves on which teachers are to be train- 
edt since within existing time constraints all experimentally trained 
teachers probably cannot be trained to make all the n>oves in all of the 
domains* Although individual researchers may have their own strategies 
for approaching the selection problemj a good way to approach it appears 
to be to follow the taxonomy of moves for teachable objects already pro" 
duced by Cooney, Davis, and Henderson (1975)* Thus, an initial step would 
be to restrict the moves to be learned to a specific subset such as chose 
related to denotative concepts* "^ie second step would be to make a 
division between the connotative and denotative moves* A third stepj in 
the judgment of the writer, would be to regroup the moves within these 
subsets according to the subjectively estimated probability that a parti- 
cular move will have to be made by a teacher instructing at a particular 
level if the concept (principle or skill) is to be learned by students* 
Thus T teachers in che primary grades will be taught a somewhat different 
set of moves than those teaching algebra or geometry ir\ secondary school* 

Following these steps focused on the selection of the concepts on 
which the experimental teacheris are to be trained^ the next step is to 
produce the procedures by which the teachers are actually to be trained* 
These procedures are dealt with in detail In the paper by David GliessmaUt 
and will not be elaborated la chis paper. The final step prior to actvially 
doing an experiment is then to trsiin the teachers ro criterion, with the 
specific moves on which they are trained determined by the arrangement of 
the experimental treatments* For example^ one group might be trained 
entirely on giving examples and nonexampleSj another on sufficient 
conditions and differentiation moves and on example-nonexample moves, 
and so on, until the experimental treatments the investigator wishes to 
employ are exhausted* The number of treatments the experimenter seeks 
to employ must of coarse be limited since each addition Increases the 
complexity of the ejrperlmental design, which^ given the other variables to 
be taken into account, is already complex* 

A feature of this stream of research which must occur during the 
experiment Is the observation of samples of the actual moves made by 
the experimental teachers during instruction*. These observations must 
be done in order to determine whether or not the differences In training 
the teachers appeared in their actual behavior. Additionally, these 
observations may be correlated with student learning outcomes to discover 
associations between the latter and the teacher behaviors actually used 
by the trained teachers* A simple model showing the relationships in 
question appears in Figure 2* 
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In this podelj relationship 1 is between the observed behaviors 
of thti trained groups (X^ ^^^^ va. X-) ; relationship 2 is comprised of 
the correlations of the pooled behaviors X.^ X^^ and the pooled out- 
comes 0^, while relationship 3 is the contrast in outcomes 0^ vs * 
vs.O t for trained teacher groups B and C, when relationships .1 and 
2 are disrtigarded. 



Trained Obse rved Student 

Experimental 1 classroom 2— Learning 

Groups Behavior 

A X, _ , 0^ 

A 

\ - 



C — 

.3 



Figure 2* Relationships among trainings 
classroom behavior^ and student learning. 



Domain 4. Student Learning Outcomes 

As a rule, one gets what he teaches for* Thus, if students are 
Caught applications, they will perform when applications are requested^ 
or if they r^re taught to verbalise generalizations^ they will return 
thfise to the teacher when tested for them* It is always difficult for 
researchers ro keep this principle in mind since they are invariably 
hopeful that students will generalize their learning considerably beyond 
what was acttially taught* 

The critical tasks for researchers in coniJldertng learning 
outcomes associated with teachable objects tn mathevnatics are first, 
CO sec forch trhe indicators in student performance which one will cake 
as evidence of learning, and second* to be able to specify^ if at 
all possible, the relationship between the experimental treatments 
and different types or levels of indicators. Irt an ideal taxonomy of 
teachable objects x teaching strategies, the performances which indicate 
that studenta grasp a concept or principlct or can perform a skill 
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would be given. In t:h£ Kenderson taxonomy as presented by Cooney (1974)i 
howevett these indicators are not developed, or at least not clearly 
developed. This gap in the taxonomy throws to the research investigator 
the problem of completing the taxonomy on an empirical basis. 

To see this point more clearly, it is useful to return to the general 
proposition stated earlier. In this proposition the claim is made that 
*'teaching scraCegles S^., S^t will produce student outcomes jO, such that 
for all indicators of 0^ I , I^j,,,^! , 1^0 ^ S^O > S^O, . . It is clear^ 
however* that this proposition can be^true only if I.* I^^f^'l^^ ^ 
homogeneous set. If the set of I is he terogeneoua » then it could be 

true that Sj^ii'*i9li='i3i^ but that S^I^ ^-2^2 ^-3-2* ^^^^ -1-3 ^-2^3 
>S^I_3, Indeedt this appears to be what happened in the Do ssey -Benders on 
study as reported by Cooney (1974, p, 169)*. When it does happen^ the 
investigator reports the differential outcome and in essence completes 
the taxonomy for the set of strategies tested x the teachable object 
chosen x the outcomes obtained* according t o t he indicators used ^ for 
the level of student employed in the experiment*. The essential point to 
be made here is that che taxonomy cannot be accurately completed^ which 
is the objective of the research^ unless a spectrum of indicators of con^ 
cept, principle* or skill learning is initially provided by the investi-^ 
gator, 

Wliat the necessary and sufficient (or at least sufficient) indicators 
are for concept^ prlnciplej and skill learning in mathenjatics is a matter 
better dealt with by mathematicians chan by the present writer, A few 
obsei'vations about indicators might, nonetheless, be tnade at this point. 

First*, one way to develop indicators is to use the teacher moves in 
the taxonomy as the foundation for the sets of indicators. This can be 
done because each teacher move displays a different aspect of knowledge 
about Che teachable object. Thus, differentiation moves or instancing 
moves are implicitly taken as evidence of knowledge of the object. 
Collaterally, student responses to questions based on these moves are 
evidence that he or she has attained the knowledge. Technically speaking^ 
mov^s should be organized In such a way that as one goes from one move to 
the next successively more information about the state of knowledge of the 
learner is revealed. For example^ a <lif f erentiation move seems to be at 
a slightly higher level of knowledge or learning than a positive example 
move since differentiation requires knowledge of the criterial attributes 
of two concepts rather than only one concept. 

If teaching moves are used as the foundation for generating indi- 
cators of student learning* one should notice that the second of the 
two problems initially stated i^ helped toward solution*. Namely, an 
implicit relationship is formed between what the teacher does (make n^oves ) 
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and vhac the. student Is tested over (items which requitis the knowledge 
revealed by these moves)* Indeed^ it is perfectly reasonable to hypo- 
thesize that the se<tue^lgg of moves made by the teacher is less impor- 
tant to learning outcomes thai^ whether the combination of moves made 
increases the total information (or knowledge) available to the student* 

Seconds although it is true that problem- solving or ''application'* 
is an e^itremely important outcome of school mathematics, it is also true 
that what is learned at one level of mathematics must facilitate what 
is learned at subsequent levels if mathematics instruction is to succeed 
in the long run* It follows that while one very much needs to develop in- 
dicators of the student's ability to solve problems involving a concept* 
principle^ or skills it is also important to develop indicators that the 
learning associated with a teaching strategy results in proactive posi- 
tive transfer to other related mathematical learnings* To develop indi- 
cators of this type requires the experimenter to provide two successive 
learning tasks for students* In the first, students are taught a teach- 
able object by the several strategies selected by the experimenter* The 
outcomes can be tested by the usual indicators (e*g*, items representing 
levels of Blootn's taxonomy)* In the second experiment, however » the 
learning task involving a new teachable object is presented to all experi- 
mental groups by the same strategy* and either the time needed to acquire 
mastery of the new teachable object* or the degree of mastery of it^ or 
both, are taken as the criterion variables* If one of the strategies 
utilized in the first experiment has a facilitative effect on the acqui- 
sition of the new teachable object* a between-groups comparison of the 
level of performance on the criterion variables in the second set will 
reveal the degree of facilitation the earlier teaching and learning had 
on the later learning* 



The objective of individual experimenta examiring strategies in 
teaching mathematics is to obtain an estimate of t^e truth of the under- 
lying arguments in the simplest possible ways* Central among these argu- 
ments is that the combination of types of moves made by the teacher is 
significant to learning teachable objecta in mathematics* A major feature 
of teaching moves » in addition to the combination of types of moves* is 
the quality of each move made* The quality of a move has at least two 
attributes: clarity and the information revealed by the content of the 
move* Dodd (197A) has recently shown that the rated clarity (clarity as a 
high infereni^e variable) of the teacher's presentation in teaching mathe- 
matics (fractions) accounts for a very substantial percentage of the 
variance of learning attributable to teaching* Thiagarajan (1971) and 
Markle and Tieman (1971) have shown^ in concept learning* that the con- 
vergence-divergence (or degree of matching) of examples and nonexamples 
Is an Important aspect of the content of exemplification moves* It 
follows that in the design of experiments involving strategies for teach- 
ing concepts, a warranted inference relative to the comparative 
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effects of two or more strategies might be <Jrawn only if each strategy 
involved is equivalent in clarity and in the content of the exemplifi- 
cation moves* Otherwise, the alternative hypothesis that any differences 
among strategies is attributable to differences in either clarity or in 
content is viable* 

Controlling for or directly testing for the influences of the quali- 
ty of teaching moves is at present critical for the survival of research 
on teaching strategies* The review of research on strategies by Dossey 
(in this monograph) produces relatively little evidence to increase con- 
fidence that strategies make any difference* In the studies reviewed, 
however, little control over the <iuality of the moves was apparently 
exercise^J* Thus, an initial move to be made is to produce a design 
which is similar to those previously used, but either (a) closely con- 
trols quality or (b) examines variations in quality while testing differ^ 
ences in strategies at the same time* Of these two alternatives, (b) is 
initially the better^ a.lthough not necessarily the simpler, since it can 
be made to yield more information than alternative (a). 

Design 1*1 Monadic Definition of '^Strate^y " 

Intent * The intent of this design is to deterniine the contribution 
of (a) two teaching strategies^ (b) two levels ot clarity^ and <c) three 
levels of convergence-divergence of examples to selected pupil learning 
outcomes rel^itive to one, and possibly two or more, denotative concepts* 
This basic intent, however, may be intrinsically compromised in the 
design since it is constructed as if clarity, exemplification, conver- 
gence-divergence, and teaching strategies are independent or orthogonal 
variables* Quite clearly, they could be correlated* If they are, the 
outcome could be <a) itmnense difficulty developing the treatment (for 
example, making up a treatment that is low in clarity but has several 
divergent examples) or (b) weak or absent main effects and large diffi- 
cult to interpret interactions* 

Design validity * The emphasis in the design is on internal rather 
than external validity, thus sampling from the various relevant universes 
Is nonrandom or "fixed, ^' It follows that genera li^at ion to different 
levels of students^ to the type of teaching moves, and to the universe 
of teachiible objects cannot be made* An Important consideration in the 
design, however. Is that It is to be replicable at different ages or grade 
levels and with different teachable objects in the concept domain* On 
the whole> independent replications of the design in this way will build 
(or fail CO build) confidence in the generality of the effects more 
quickly Chan will any alternative procedure* 

An aspect of the internal validity of the design which cannot be 
overlooked is the e^se-dlfficulty of the teachable objects chosen* To 
make a fair trail of the strategies argument or of clarity or the content 




ERIC 



of the examples, the teachable objects must be drawn from those Identi- 
fied as 'Mif fic'Jlt/* A ptoblom for the experimenter is to find a set 
of procedures by which to isolate the difficult concepts. One procedure* 
mentioned in Section I, is to refer to the research literature. A second* 
and probably tmre expedient ptoceduce. Is to have icithematics educators 
or math&matlcs teachers familiar with the concepts taught at a particular 
level (or narrov range of levels) rate concepts for how easy or hard they 
are to teach and correlatively i how easy or hard they are for students 
to learn- The concepts used in the design would then be selected on the 
basis of these ratings, with the additional constraint for younger 
students that they be within the range ot noru^al development for the ages 
of the children, 

In addition to the ease-dt £f Icul ty matter, the normal Items of 
internal validity are to be observed- These items include the random 
agsj-finment (but not necessarily random selection) of subjectSj the effects 
of maturation, attrition from the experiment, the intervention of 
exttaneotjs factors during the ejcperiment, and so on. 

Treatment construction . An initial choice is whether to use one 
concept or more than one in the treatment. Using a single concept 
shortens both the development time for the treatment and treatment 
administration time. Using two different concepts, of eqtial difficulty, 
on the other hand, permits a partial replication of the experiment rela- 
tive to the domain of difficult concepts for the age level chosen*. In 
addition, e>;ternal validity is Increased on this dimension as well as conserving 
experimental, subjects In the sense that each subject gives twice as much Infor- 
matioi^ as he otherwise would have, I£ the choice Is made to use one 
concept only, the design remains basically a 2 x 2 x 3 ANOVA- If two 
concepts are used, it becomes a 2 x 2 )c 3 repeated measures, assuming 
equivalent tests for the two concepts can be constructed. 

Following the selection of the concept(s), the subsequent tasks are 
to vary both the convergence-divergence of the exemplars to be used and 
the cLaricy of the characterisations of the concepts* This is dont while 
working within the constraints of a fixed rangp^ tor the number of moves 
permltced In each strategy. This range should probably not be fixed 
exactly at the outset, Ratheri the problem *t developing examples should 
be worked on firsts then the cut-off points on the number of exanipLes to 
be given Is set according to the difficulty ''^K the concept. It Is assumed 
that mastery of a more difficult concept requires more examples than a less 
difficult concept/ Failure to give enough examples for at least the 
brighter students to learn the concept well would not provide a completely 
fair trial of the basic argument, while giving too many examples might 
obliterate differences between the treatments*. 

To obtain a range of variation in example.*; and in the clarity of the 
chariicterliiatlons employedj a good initial procedure is to ask students 
in a methods class in mathematics education as well as expert mathematics 
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educatacs to write out chacactecizations and examples and nonexainples 
of the concepts* This procedure should produce samples of examples and 
nonexatnples and of characterizations. Each sample can then be ordered. 
The sample of characterizations can be ranked or stratified by clarity. 
The sample of exanipies can be ordered on a bipolar continuuiD from highly 
convergent to highly divergent, and the sample of nonexamples can be 
similarly ordered . 

To do such ordering^ definitions of convergent and divergent examples 
and nonexamples are needed. These definitions depend both on the series 
of examples within which a particular instance ir buried and on the 
presence of irrelevant attributes* A convergent positive example Is one 
in which the irrelevant attributes differ only slightly {e^g,^ by one 
attribute) Eroni the criterlal attribute(s) while a divergent example is 
one in which many of rhe irrelevant attributes vary, A convergent non- 
example on the other hand is one In which the irrelcvanr attributes, are similar 
ro rhosc of the initial exairplej but one* criterlal attribute is removed. 
A divergent nonexample varies widely from the initial example. In 
irrelevant artrlbutes, but continues to remove at leasr one (or v^sslbly 
more than one) criterlal attribute. As a brief and incomplete examplej 
consider teaching the concept of fottr to a young child. If the initial 
example is four green pencil marks^ a convergent example is four bleck 
peiicii marks and a divergent example is four red sky scrapers with windows 
in them, A convergent nonexample Is three green pencil marks, while a 
divergent nonex^imple is six purple moons with faces. 

Once the samples of examples, nonexamples, and characterisations 
are ordered^ the next step is to select from each Siimple those specific 
items which might be employed in the experiment*. To take this step the 
exact teaching strategies to be used in the particular experiment must 
be consl laL'ed, Certain constraints and certain options are available* 
One constraint developed by eailier decisions and procedures is that the 
GKemplif icat ion moves to be made are to provide Interpretable contrasts 
between different combinations of types of positive and negative examples* 
This constraint suggests thar at Icasr three combinations of examples and 
nonexamples must be Included such that each combination has balanced 
(equivalent numbers) examples and nonexamples, and 

(a) combination 1 uses all convergent examples and nonexample^t 

(b) comblnjation 2 uses both convergent and divergent examples and 
nonexamples In equal numbers^ and 

(c) combination 3 uses all divergent examples and nonexamples, 
excludjng the first ones given as examples. 

Quite clenrlyj these combinations are not the only ones possible since 
any ratio of convergent to divergent examples and nonexamples would be 
permissible. The combinations chosen^ however^ provide reasonably inter7 
protablc contrasts among the full range of possibilities. 
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A second constraint from previous decisions atid procedures is 
Chat the combinations of example-aonexa^nple moves chosati must be 
fit lato different patterns which are interpretable as teaching strate- 
gies in the Henderson taxonomy. Ideally^ thesje strategies should be 
drawn at random from that subset of concept teaching strategies for 
deaotative concepts which Involves repeatable charac terlsacioa and sxetn" 
plificatlon moves* This subset is not presently expllcatedt however, 
aad Che only praccical alcernat.lve is to draw at Least two contrasting 
strategies from it on an intuitive basis* For preseac purposes^ let 
us designate one scrategy asaCE^EE'^ECE'V'EE^'EC strategy 
in which the connotatlve or characterization moves are dispersed among 
counterbalanced eJtample and nonexample moves* This strategy is thus 
a "dispersal strategy." The secc;id strategy shifts away from dispersion^ 
and blocks or clusters the moves as follows; CCCI^EEEt/E'^E^E 

E, Quite ciearlyj many other specific strategies involving the same 
elements in different arrangement could easily be generated. The present 
design does not directly utilize these alternatives, but can be quickly 
modified to ndapt to them as will be noted at a later point* 

The remaining step in the design is to contrast '^clarity" In at 
least two levels, A procedure for obtaining differences in the clarity 
of characterization moves was discussed earlier and iniciallyt ac least* 
less clear and more clear moves can be assigned to the strategies in a 
balanced design* To see this point more clearly^ Figure 3^ which arrays 
all the elements of the design up to this point, should be examined. 

The face that "clarity" as applied to teaching mathematics may 
involve not' only whether the characterization <C) moves are clear but 
also whether the entire sequence of moves is clear is now open to an 
empirical test. To make the test, the instructional programs for each 
cell* a to 1 in Figure 3, must be written. These programs are then assigned 
to a panel of judges* for example* a mathematics education class* Each 
judge then rates each program on a scale of 1-5 for clarity* These rat* 
Ings are then collected and assigned to the cells in accord with the tyPe 
of program on which they were made. An AMOVA of the ratings is then 
performed. If "clarity'* is a fv-nction of the clarity of the characteri- 
zation moues^ a main effect for B will be present such that the mean 
ratings for the less clear cells (a-f) will be less than those for the 
more clear (g-1) cells. If clarity is a function of some other factor 
such as strategy, or convergence or divergence* or some combination of 
factors* it will appear In the other main effects (A or C) or in the 
interactions Ce*g,, A x C)^ hopefully in an i/iterpretable way. Notice 
that this analysis does not reveal anything about the relation of clarity 
to learning; it tells only whether or not clarity Is orthogonal to 
strategies and convergence-divergence or correlated with one or the 
other or both^ hence confounded with ther. in this design* 

Assigning subjects to^ treatmeji^ts^ , A distinct advantage to rhe 
programmed learning approach co studying teaching strategies is that 
it permits the random assignments of students within intact classrooms 
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of design 1*1, 



to the treatments;. The randomizing procedure is carried out by assembling 
the total stack of programs to be harided out In a classroom in random 
order^ then passing them to students^ who thereby receive their treat- 
ments at random* 

This procedure solves four Important problems* Plrat, it permits 
the use oil a randomiaed design with high initial internal validity* 
Second^ it permits the experimenter to treat each student as one repli- 
cation or unit of observation^ thus permitting him to use each student 
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as one d^jgree of freedom. If Intact classes are randomly assigned 
to creatmencs, as an alternative practice^ each cLaas is only one degree 
of freedom. Third, it adapts easily to covariance or stratified designs 
as methods to increase statistical precision* since the control variabie(s) 
to be used will be available on a student by student basis* Finally, the 
randomizing procedure used cav^ be expanded up to about 30 different treat- 
ments (one student per treatment in an average classroom), thus per- 
Ttiitting many different teaching strategies on the satne concept (principle 
or skill) to be tested simultaneously* In short, the procedure lends It- 
self to greatly increasing the sample of strategies used In any one study! 
hence, it helps in solving the e^^ternal validity problem associated with 
the large universe of possible strategies* 

Testing learning outcomes * I am going to minimize this aspect of 
the present design and related designs because an adequate treatment 
of it requires another complete paper* There are, however, certain 
aspects of testing outcomes chat cannot be overlooked even here* 

First* the method and the problems by which learning is to be 
assetised must be considered, and should be rather fully developed, at 
the cime the concepts to be Included in the treatment are selected* For 
example, If **fourness'* were the concept In the present design, the test 
of the outcomes would In all likelihood be the correct discrimination 
of fourness among many divergent examples and nonex^mples of fourness* 
The test would be almost certain to closely resemble the treatTnents 
delivered In cells e and k of Figure 3, Such a test might be considered 
an inadequate or even biased assessment of concept learning* The time 
to make thlti judgment is, of course, before running the e^^perlment, aot 
afterward * 

Second, if multiple tests (sets of Indicators) of the learning 
outcomes were used, and in the event these Indicators were somewhat 
heterogeneous* i*e-, did not describe a unitary factor, the statistical 
analysis dissociated with the design would shift from univariate analysis 
of variance to multivariate analysis of variance* 

Third, in the event two concepts were taught In the present design 
{i*e*, a partial replication was done) and were tested with apparently 
paraJleL tests, the scores of the tests would have to be equated through 
a standard score transformation before initiating the analysis* Other- 
wise, tho difference between the concepts, as treated, would be con- 
founded with possible differences between the tests of coricept learnlngi 

Expected outcomes * With respect to the argument that teaching 
strategies affect learning outcomes, the expected outcome for this 
design Is a significant difference b'^^ween strategies* Additionally, 
significant effects for levels of cl^.^lty and for types of e^^amples- 
nonexamples would be anticipated* An acceptable and illuminating set 
of outcomes would be a significant A x C interaction (strategies by types 
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of eKaiuples-nonexamples) siace this effect would iitill indicate that the 
sequence as well as the quality of the moves Is important, A theoreti- 
cally disappointing but empirically interesting outcome would be a main 
effect for clarity and no other significant results. 

Related expcri merits , Depending on the outcomes of the type of 
experipent described above, a number of related experlDients can easily 
be generated. If the anticipated outcomes hold* the same experiment 
can be repeated for different concepts and/or different age groups. 
If the convergeiit-divergent examples effects are stroiig^ this line 
of research can be extended by examining different ratios or different 
numbers of examples and nonexamples> convergent and divergeiit. If the 
strategies effect is strong and the other effects weak* an Interesting 
scries of e:cperlments might be conducted to determine the most efflcieiit 
strategies for attaining a given outcome by manipulating either the 
number, repetitions, or types of moves made. Whatever series might be 
chosen* the theoretical objectives are similar — to verify or to modify 
and refine the ci:rrent theoretical structure so that It more sharply 
explains the relAtlonships between the moves of the teacher and the 
learning outcomes of students in mathematics. 

Design 2,1: Dyadic Definition of "Str^itegies'* 

In this design the intent Is to carry out research which is as 
closely analogous' to design 1,1 as possible* but employs a dyadic or 
student response-contingent definition of teaching strategy rather than 
a monadic definition. Quite clearly^ design 2,1 cannot be exactly par- 
allel, to 1,1 since the exact sequence of moves* the strategies, cannot be 
directly controlled. Rather, the strategies must be left as conttngeii- 
cies. Moreover, neither convergence-divergence nor clarity can be coii"' 
trolled since these are also a function of the te^icher and left contin- 
gent. What can be controlled, albeit imperfectly. Is the degree to 
which the teachers tn the escperiment have been trained to (a) perform 
moves relevant to teaching concepts^ (b) give convergent and divergent 
examples and nonexamplcst and possibly (c) be clear. 

Design structures^ cost and intent . The structural features of 
design 2.1 might be very similar to those of 1,1 if training capabilities 
and the cost of conducting the experiment were to be completely discounted* 
In this event, the structure would be that in Figure ^, 

This design structure differs from that in 1,1 in that convergent- 
divergent example and nonexample giving is not divided into three levels, 
but only two. The reason this factor is collapsed is that training 
teachers to give all convergent, all divergent* or balanced convergeiit- 
divergent examples and nonexamples probably cannot be controlled at the 
point of application. That is, even though one might try to train 
teachers to act exactly in accord with these treatments, when the teachers 
actually teach they might or might not act in accord with their training. 
The treatments are therefore simplified so that some teachers are trained 
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in giving convergent and divergent examples and nonexamples and some 
are not thus trained. 

In addition to this structural change between designs 1.1 and 2,1^ 
there are c:ertaln other features of 2<L vhich are questionable. The 
first is whether or not one could^ within reasonable time limits, 
successfully train teachers to be '^clearer." This seems doubtfulj 
since exactly what one must do to increase his clarity of presentation* 
questioning, example giving, and the like is poorly understood. To s^y 
that one can discriminate between clear and less clear teaching is 
different than saying that one can train someone to be clear. Working 
on the latter notion, the eicperlment could drop clarity as a training 
treatment and, instead^ rate the clarity of teaching actually done in the 
experiment. In this way, clarity could be tfeared either as an outcome 
of the other two factors in the design or as a control variable (co- 
variace) or both. 

Dropping clarity as a training treatment would also have a bene- 
ficial effect on the costs of the experiment since four of the cells 
Ce, f, g, h) can be eliminated and correspondingly fewer teachers and 
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stud^ncs included In the experiment*. In many experiments, for 
example J those like 1*1, this cost reduction would be small* But in 
2*1 the pctrticipating teachers must be both trained and subsequently 
observed or videotaped and rated* Thus* reducing the number of parti-' 
cip^nts c<in effect substantial savings which can be divortod to 
additional experiiaents* 

The second feature of design 2*1 open to question is whether or 
not training someone in giving convergent and divergent examples 
and nonexamples is in effect training him to make teaching moves 
(example and nonexample moves)^ which of course it is* Nonetheless> e 
discinccion can be maintained in training between teaching someone to 
vary the quality of his example -nonexample moves and simply teaching 
him to make example and nonexample movies* If this distinction is not 
maintained in 2.1} the validity of the design relative to its intent 
will be compromised* This compromise will occur if in training 
teachers to give examples and nonexamples, as urell iis other types of 
moves, the experimenter inadvertently emphasizes the types of examples 
or nonexamples Lo be given. 

Let us suppose^ however^ that the experinienter b&lieves that he 
cannot avoid addressing the quality of the examples and nonexamples 
given in his training on teaching moves* If this were to be the case, 
he might again shift the structure of the design so that only two 
groups (cells a and b) were Involved^ thus dropping the convergence- 
divergence of examples and nonexamples as an explicit factor in the 
design* In keeping with the intent of both design 1*1 and design 
2*1* however, one might reasonably insist that convergence-divergence 
of examples and nonexamples be taken into account. To meet this in- 
tent, the experimenter would observe £ind rate the teaching of the 
trainees on the convergence-divergence factor* He would in turn use 
these ratings in two ways* First j he would test the differences 
between the mean convergence-divergence of examples and nonexamples 
given by teachers In cell ^ versus cell b^* This test would tell 
whether or not his training Influenced this factor* Second* he would 
correlate the ratings for cells a^ and b^ pooled to student learning out- 
comes* This correlation would indicate the degree to which convergence- 
divergence influenced student learning outcomes* Finally, he might 
use the rating as a covarlate to Increase the statistical precision of 
his design* The latter m-^ve would be made^ however, only if the 
correlation between the rating and student learning was substantial — 
say greater than .50* 

Treatpient construction - teacher training * A curious feature of 
design 2*1 is that its structure depends greatly on how skillful the 
experimenter thinks he is in constructing training treatments* For 
present purposes, the writer will assume that the four~cell structure 
can be carried out If the appropriate training materials are developed* 

An important consideration in developing these materials is their 
cost* If substantial sums of money are available^ the materials might 
include films or videotapes showing teachers modeling the moves chat 
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tbe trainees are to learn, ?rograimed materials would follow which 
require the trainee to both discriminate the appropriate behavior 
in transcripts of teaching and also produce examples of the appro- 
priate behaviors. If modest sums are available^ audiotapes or simply 
transcripts may be used. If virtually no money is to be had, the 
experimenter may himself have to give the instruction in a highly 
structured replicable way. 

For the treatment which trains teachers to make relevaiit moves in 
teaching concepts, the experimenter has the option of teaching all 16 
concept moves if he chooses- He may also choose to teach only a few 
moves, but certainly more than just example and nonexample moves, which 
would increase the risk of confounding the two treatments In design 
2,1, The investigator also has the option of developing materials 
separately for each individual move or for groups or clusters of moves. 
If many experiments using different types or combinations of moves are 
planned, as would be the case In a family of experiments related to 
design 2,1, much is to be said for having separate materials for 
each move. Different combinations of moves for different training 
treatments could thereby be easily produced. 

An important aspect of training on concept moves is that the In- 
vestigator must establish a criterion for trainee proficiency in making 
each move. This criterion might be to Identify and differentiate types 
of moves as well as produce moves with high accuracy on a paper and 
pencil test. It might be ability to accurately perform each type of 
move in a mlcroteaching situation. Which is chosen depends substan- 
tially on the time and money available to the investigator. 

For the treatment which trains teachers to give convergent and 
divergent examples and nonexamples, the same type of training materials 
used to teach concept moves is required. However, Instead of noting or 
even mentioning "moves,*' these materials focus on the importance of 
giving good examples and nonexamples in one's teaching. Then they go 
on to demonstrate different types of examples and nonexamples and 
when they might be used. Again, a criterion for trainee proficiency 
In giving examples and nonexamples, convergent and divergent, must 
be developed by the investigator. 

Treatment construction - concept teaching . Once the participants 
in experiment 2,1, ceils b, c and d, have been trained, all partici- 
pants including those in celT a_ must be assigned to teach one or more 
than one concept to children in the designated age range. The concept{s) 
would be selected in the same way as in design 1,1, In design 2,1, 
however, all participants must be given access to the same resource 
material about the concept(s) and given equal opportunity to prepare 
the instructional lesson. Finally, each teacher must be assigned at 
random to one or more microteachlng sessions* to which the pupils 
also have been randomly assigned, with the number of sessions determined 
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by the number of concepts used* Following each session, the students 
3re tested for concept acquisition, while the videotapes of the session 
are saved and subsequently rated for clarity* In additioni the tapes 
also may be examined or rnted relative to cho strategies employed and 
the convergence-divergence of the examples and nonexamples used* 

Interpretation ot results * The statistical analysis used in 
design 2*1 might be a two-way analysis of variance, with repeated 
measures if more than one cc^ncept is Caught, or analysis of covariance 
if clarity is significantly correlated with student outcomes* Under 
any analysis, however, the design should be about equally tnterpretable * 
If the main effect for concept moves is significant, then training 
teachers to make these moves aids student concept learning' Whether 
this outcome is a consequence of one or more specific strategies being 
employed by teachers can be determined, however, only by an analysis 
of the videotfipes. The same is true if a significant main effect occurs 
for the convergence'-divergence factor* Perhaps the more likely outcome 
of design 2*1 is a significant interaction effect which results from 
highly superior performance by the group (cell d^) trained both on moves 
and on convergence-»divergence of examples and nonexamples* 



The design of research on ti aching strategies requires attention to four 
domains of variables! teachable objects, student attributes, teaching 
moves and strategies, and learning outcomes* Within each domain a 
further classification of variables is required* These classifications 
should produce sampling frames from which elements may be dravn either 
to increase the possible generalisation of the research findings within 
the domains or to increase the precision of the experiments to be con- 
ducted* The design of experiments involving these sets of variables 
requires detailed attention to the method of selecting the variables 
to be employed from each domain, to the procedures for operationalizing 
these variables, and to the control of variables which potentially offer 
competition with "teaching strategies" as alternative explanations of 
the results of the experiments* 



Summary 
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A Research Cunu^jxt for 
Delivery Systems Researctk on 
Strategies for Teaching ^fathetnatics 
Kenneth A» Retzer 
Illinois State University 

A Utopian^able 



The Utopian States has a prcblm* A team of re8&cirche:)^s hosj 
by studyiyig hiortan h^JiavioVi idsntifisd a regimen of physical exeraiees 
whiah can benefit a st^stantial portion of the population of Utopia- 
provided one cxtn trust ths prelitrrinavy indications of r&Qearch, 

The v^searohevs a^s snthusiasticj dissemirjation of these 
regimens of sxereis^ could he rneans by uhich they make a contri~ 
butian to humanity* Excitstnent is tet?pered by honest joncsm ctout 
pihlio acceptance of ths potential of these vegim^ns. They kno) 
that people are alveady getting exercise in nierjevous ways — both 
€tri4ctta*ed and unstvuctursd — and they realize that they need to 
convince Qome that atructuved activity is mors effective than 
unstru£itured exercise without having them feel their freedom or 
artistic expve^sion is being restricted, T^tey need to convincs 
others i^ho believe in structured exevcise that thsss regimens 
are more beneficial than those they are presently using, 

Fuvthe^vi^T^e, they are con':^emed about the point at uhich there 
will be enough research evidence to convince t^tem that some of the 
regimens of exerci^re might b e more b eneficiat to them and to those 
they train than those they ore presently using, Hcw can they get the 
financial support and the time for that needed research, and hOD 
can they coordinate those research efforts to make the maximum 
use of fundsj mutual communication ^ and fiupport andj simultaneously j 
minimise overlapping of efforts and insignificant research? 

This fable about the Utopian States has a counterpart In the United 
States^ If e>cerclse can be compared to teaching activity classified as 
teaching moves and regimens of e>cercis6 to teaching strategies whiub 
result from sequencing tho5e moves, we may be able to visualize the nature 
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and th& state of the movement in strategies for teaching mathematics * Ue 
see» us the Utopian researchers do^ the need for adequate research to 
identify effective strategies and means of sharing the research with prcs- 
service and Inaervice teachers. 



White the pvcbl&ms of research si^pport arid research coordina^ 
Hon are forrnfidable ones^ they are solvable. As evidence rnoimts^ 
the resaai'chers b)ill be dble to decide uhether to continue testing 
the effectiveness of specific exercise regimens and i}hether to use 
this evidence in an effort to convince others to use those regimens 
identified as effective. 

Problems of implenmntation and dissminntion arise. Surely 
the Utopian ptblio schools are the single most promising dissemina~ 
tion source since they are already involve in teaching physical 
activity. Would riot the physical education departments be the 
most promising departrtients loithin the piblic scliools to learn the 
moves involved and to teach their students to sequence these moves 
into regimens of exercise? This possibility raises numerous prcb'- 
lemB and cliallenges. While not discounti^ these avenues^ the 
rcsearohers do not feel that dissemination by cofmunity organiza~ 
tions, federal agencies^ or interested individuals can have quite 
th& i^ido' spread effect as the schools. 

Of course^ other departments such as home economics^ industrial 
technology^ and art are also concerned with physical skills. But one 
liiould not expect these departments to be a major source of 
dissemination unless research makes it evident that the regimens of 
exercise are most beneficial to those in a particular department. 
The fact that most of the researchers have backgrounds in industrial 
technology and that the moves were diocovei^ed by dbservirig physical 
activity related to industrial techriology leaves open the question 
of whether these exercises are pritmrihj beneficial to those i^t 
industry as contrasted with the general populace. 

Among the physical education faculty there are those whose 
backgrounds are in industrial technology. Some have specialized 
in exercises beneficial to those in industry. These are among the 
physical education faculty who would make decisions about imple^ 
menting the exercises suggested by the researchers. By virtue of 
their positions^ they have an interest in industrially' related 
exercises as well as feelings about the effectiveness of what 
theij are presently teaching. 

To our researchers^ art analysis of schools and physical 
education departments is in order* Our i^esearchers are assuming 
that the physical education departments as well as other depart^ 
ments Jiave ci4n*icula i/>hich are based on research. Before they 
would adopt neu regiments of exercise <xs a part of their curricula^ 
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they would Dan t adequate reseax*ah evidence of their effectiveness. 
They are quite prepared for the fact that some^ because they 
would prefer to cBjavt the results of tapge-scale research^ will 
not be convinced by pilot pi^jectn and omall^ccate reseax*ch~ 
Utopian researahers are quite prepared to itnplement their regi- 
mens of exsroise in a fOi) Schools and design i^s&arcyh which tests 
whether these exercises help the schools achieve their cbjectives. 
Assessing the realism of those asswjiptions and giving preliminax'y 
consideration to the timing and structure of research on educa- 
tiovjLl systems is worthy of consideration^ 

The analogy can be continued by comparing the public schools to our 
teacher training institutions* the physical education departments to 
colleges (or departments) of education, and the industrial technology 
departments to mathematics (or ma^tUemattcs education) departments. 

By doing; sq» one can. perceive a web of interrelationships between 
research and dissemination. Researchers^ committed to exploring the 
relative effectiveness of strategies for teaching mathematics, can coor- 
dinate a spcictrum of small-Scale studies. Such studies can point toward 
large-scale studies to determine whether knowing moves for teaching con^ 
tent Increases teacher effectiveness. Simultaneously, there is a need for 
dissemination of existing; classification systems -^f teaching strategy 
moves. This dissemination Is both a means and an end. It is a means In 
the sense that it ts prerequisite to large-scale validation studies. It 
is an end in the sense that strategy moves have already exhibited suffi- 
cient potential and usefulness to varrant their being shared. The effec"" 
tlveness of delivery systems used to shar^ strategy moves can be tested* 
This interrelatedness of research and dissemination efforts warrants 
further exploration- That exploration is the task of this paper. 



The Task 



A major purpose of this paper is to explore aspects of research with 
and dissemination of classlEicatlon systems of moves for teaching mathe* 
mntical concepts, generalisations, or skills. Specifically, this paper 
sui^gests (a) that validation studies of the type Dossey (see the Dossey 
paper In this monograph) describes be continued, <b) rhat similar valida- 
tLon studies in other subject matter fields be considered, (c) that large 
scale validation studies on strategies for teaching mathematics be antici" 
pated^ (d) that dissemination of strategy move classification schemes is 
a prerequisite for large-scaie validation studies* and (e) that delivery 
system research shotild be done on the effectiveness of the resultant 
teacher education programs. This paper is largely directed to discussing 
aspects of that dissemination and subsequent delivery systems research*. 
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"Validatlon research" refers to thjiZ research which uses sequences 
of teaching moves In an effort to dctertuine effective strategies*. In the 
context of this paper, "delivery system research" means research on one or 
more components of a teacher education program to determine its effective- 
ness ' 

Exploring aspects of research with and dissemination of classification 
systems of moves for teaching mathematics is carried oot In the following 
manner. Attention Is given to the following; 

1. the nature of strategies for teaching mathematics and their 
source ; 

« promising aspects of using those strategies in teaching and In 
teacher education; 

^' some positions and suggestions for a research framework; 

facets of Implementing these strategies in some mathematics 
teacher education programs including research bases of teacher 
education curricula, modeling as a dissemination approachj an<J 
a case for materials development; and 

5* some dimensions of a suggestion for anticipated delivery 
system and validation research in mathematics education on 
teaching strategy moves* 

Mature and Source of Rirategy Moves 

A strategy for teaching inathematlcs Is a sequence of bits of verba- 
lisation called moyes^ . The strategy mo,ves In current usage were identified 
by analyzing tapes of classroom discourse with a logical perspective — 
keeping in mind whether a mathematical concept, principle, skill, or fact 
was being taught. Henderson offered classification systems of these moves 
in articles and chapters of professional publications as early as 1967* 
The most complete single source Is a secondary mathematics education 
textbook by Cooney, Davis, and Jfenderson (1975). This text contains 
classification systems of moves for teaching mathematical concepts, mathe- 
matical generalizations, and mathematical skills within one volume and 
reflects the latest thinking of these mathematics educators. 



Promising Aspects 

Mathematics teachers and mathematics educators have been drawn into 
the movement for various reasons — including philosophical perspective, 
aesthetics, appl Icablilty ^ research results, and personal experience. 
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Some find themselves in agreement with Smith <1971) who stated: 

Almost from ancient times it has been assumed that the way 
teachers should behave in the classroom could be derived from 
what philosopherfi , and in recent decades psychologists, said 
about thinking and learning. . . .While this approach to the 
formulation of teaching skills has not been abandoned, it has 
been challenged as an exclusive :ipproach by research workers 
who conceive of teaching behavior as worthy of study in its 
own right . (p. 3) 

Mathematics educators who share Smith's perspective are drawn to the 
results of Henderson^s observations of interaction in mathematics class- 
ro oms. 

Some who have been drawn into the movement find an Intrinsic beauty 
similar to that in the structure of m^ithematics. Many associated with 
mathematics appreciate that an endless number of arithmetic facts can 
be generated using algorithms and less than 100 basic facts. Similarly, 
some find the fact that an endless number of theorems can be proved with 
a small finite number of axioms aesthetically pleasing. Likewise^ some 
can appreciate beauty in the determination that the multiplicity of 
teaching episodes can be interpreted as permutations of a small finite 
number of strategy moves. 

Some are attracted by the applicability of these moves to teaching 
mathematics content — concepts, generalisations » and skills — regardless 
of the generalizabili ty of these moves to other subject matter areas ^ 
Until the extent of gene raliz ability is known, there is a possibility of 
finding teaching moves which are unique to mathematics. The opportunity 
to work with Specialized teaching moves which are used to teach mathe* 
matics content as contrasted with generic teaching moves which relate to 
classroom management, structuring materials, and manipulating pupil 
activities is appealing. 

Since Dossey (in this monograph) provides comprehensive details, it 
suffices to indicate that some are drawn to the classification systems 
by the encouraging results of some research studies. These results are 
interesting in contrast to a quotation from Rosenshine and Furst (1971) 
who stated: 

Educational researchers have not provided those who train teachers 
with a repertoire of teaching skills which indicate to a teacher 
that if he Increases behavior x and/or decreases behavior y there 
will be a concomitant change in the cognitive or affective achieve- 
ment of his students. (p. ^0) 
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Somo teacher educa s have used the strategy moves to provide a 
corranon language Co descriDe teaching and general luechods ej:plicitly. 
?resetvice and inservice teachers have reported that knowledge of the 
moves helps them (a) to write objectives, (b) to plan lessons, (c> to 
determine alternatives when classroom developments require that they 
change froin their planned .s:rategies^ and (d) to write test items. 
There are adequate subjective reasons for thinking mathematics teachers 
would find strategies for teaching mathematics a^isthetically pleasing 
and useful* Hence^ at least some mathematics educators would want to 
It.civide them in their teacher education programs* 



Positions and Suga^stjons 

A position taken in this paper is that those interested in research 
on strategies for teaching mathematics should be concerned with the 
challenges of dissemination and delivery system research on strategy 
moves from the outset of cooperative research efforts. Delivery system 
research is as important as validation studies — even prerequisite to 
large-scale validatton studies. The development and use of protocol 
and training materials in teacher education programs and dissemination of 
such materials and programs are prerequisite to research on the system^s 
ef fee tivtriiess and the production of enough teachers to permit large- 
scale validation studies. The paradigm given in Figure 1 may further 
explicate this position as well as outline a research framework. In 
Figure 1, Item (1> designates our present state* Dossey's paper sum- 
mari^es these validation studies, and his and other papers in this mono- 
graph make suggestions for further research Identified as (2). 



r*-(9) Validation Studies in 
Other Contei^L Areas 



(1) Validation SE:udies-^(2) 



Further — 
Validation 
Studies 



(fi) Large Scale Validation 
Studies in ^^athenlatics 



(3) 



Delivery System 
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(4) 



tmplementa tion- 
ModeLtng 



(5) 
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Mode ling 
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Use in Teache r— 7 3 Delivery System 
1 raining Research 
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This paper points towards Item (7) and suggests that Items (3), (4), 
(5) (not necessarily in that order) are important preconditions* Items 
<3), (4), and (5) could also lead to (6) for teacher education institu- 
tions who do not consider (7) or (3) prerequisite to curricular change* 
It is suggested that (3)* ) , (5), and (6) are also preconditions for 
(8)* Decisions need to be made on the value of (9) as desirnihle re£iearch 
and whether it should he encouraged after (2) or else (8), V!e need to 
establish several things to Implement teaching strategies into teacher 
education programs (Item (6) of Figure 1)' on a research based rationale* 
First, arc some strategies more effective or more efficient than others 
(Items (I) and (2))? Second, can teachers be trained to recognize and use 
moves (Item (7))? Incorporating teaching move classification systems 
in comprehensive teacher education programs may also require both small 
(Item (9)) and large-scale validation sUudies in a number of othet' sub- 
ject matter areas* 

With this suggested research framework in mind^ facets of implemen* 
tatioui dissemination, and prere^juisite materials production can be 
examined. It is asserted thaU implementing classification systems of 
moves into some teacher education programs is justifiable on subjective 
bases* Kost components of existing teacher education programs are not 
based on research evidence. However, the current incompleteness of 
effectiveness research on knowledge of teaching strategy moves need not 
be a deterrent to their implementation. 



Modeling as a Dissemination Device 

It Is significant that curricular development in school mathematics 
content has been accompanied by dissemination efforts. The development 
of a secondary mathematics curriculum by the University of Illinois 
Committee on School Mathematics (UlCSM) was accompanied by academic 
year institutes (AYl's) to train teachers (about 1957-1969)* The task 
for these teachers was to become thoroughly acquainted with the UlCSM 
curricular materials and their matheniatical bases* Later (circa 1971) 
the Colorado Schools Computer Science Curriculum Development Project 
(CSCSCDP) was accompanied by resource personnel workshops (RPW^s), 
The.se teachers and administrators became familiar with the implenientatlon 
of computer programming in junior level high school mathematics and the 
philosophy of the text* More recently, Indiana's Mathematics Methods 
Program (MM?) has been accompanied by a modeling program {from about 
197Z) in which visitors can study the materials^ learn to use them^ see 
them being used in a model program* and contribute to curricular develop- 
men t and mod ification. 

These three training programs were financially supported by the 
tiational Science Foundation and represent distinct programs in the 
evolution of NSF's thinking concerning teacher training. After several 
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years of retralalag experienced mathematics teachers In AYl's, support of 
the NSF was directed toward RPW's and the Iniprovement of some preservice 
education programs* The National Sci^^nce Foundation recognised the 
futility of continuing to retrain indlviJ*ial teachers, while teacher 
ecJuctition institutions were producing teachers who would shortly be in 
need of retraining* Kencc, the MSF began supporting RPW's whose parti- 
cipants were teachers, department chalrmeni and teacher education faculty 
with the eKpectation that these personnel would further dissemination by 
training others* Furthermore, support was given to undergraditate insti- 
tutions for development of their preservice programs so that their 
graduates would be capable of using the bes^t of Curricular materials 
and teaching methods* Indiana University's MMP contains a recent and 
a most promising dissemination device because of the nature of the 
modeling Inherent In it* A critical feature of the MMP includes 
support for teacher educators to visit the model and engage in follow-up 
communication, as well as the opportunity for the visitors to provide 
input to the development of the model and, hcnce^ develop a sense of owner- 
ship* These characteristics merit consideration* 

*nie MM? program represents recent thinking of the National Science 
Foundation toward dtsseminat ion* It seems reasonable, then, that serious 
consideration should be given to support of implementation of teaching 
strategies into teacher education programs which can serve as a model 
teachet education program to be visited and modified by mathematics 
educators* Such programs would not be viewed as demonstrating the ideal* 
Rather, they exemplify a definable program which Is in operation. Visi- 
tors could help Improve the model program as well as adopt or adapt 
aspects of chat model to their own situation* 

Stiles and Parker (1969) spoke of teacher education programs being 
implanted and imitated with minimal evaluation. Undoubtedly there are 
teacher training programs which will gladly imitate a promising model 
program* Faculty at such institutions are in search of fresh ideas but 
often are burdened with responsibilities which prevent them from doing 
the necessary research and developmental work* Establishment of model 
teacher education programs and provision of financial support to visit 
them and to communicate with their personnel would serve these Insticu" 
tloni^ well. 

Many teacher education institutions contain faculty who both want 
to and are expected to be productive along research and developmental 
lines. Adoption of another institution's program is highly unlikely 
In these cases; adaption is more likely. It appears that the adaption 
will be even more likely if faculty members have an opportunity to assist 
In development to an extent that they acquire a sense of ownership in 
part oC the new curriculum. Glrault (1974) stated, "If innovation is 
to remain alive beyond the introductory developmental stages, it nust 
be *owned* by the total system it purports to serve." (p* I) * She defined 
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the system members as Initiatorsj legi tlmatizers and maintainors* Noting 
that teacher education programs exist at the interface of the university 
and the school unit, she indicated that Che innovative sysCem must 

be defined so as to include representatives of each unit bordering Chat 
interface* She pointed out the need for the maintainers to have Che 
opportunity to communicate with and influence the initiators and legiti" 
matizers* The maintainers should share a sense of accessibility » connnit'- 
ment, inCetestt and mutuality of influence wich Che initiators and legtci- 
matiaers in order for all concerned to feel a sense of ownership in the 
innovation* Program owners see themselves shaping the program* as 
having easy and informal access to other owners » as being convinced thaC 
the ptogram is worthy of disseminacioRf and as seeing their ov^nership as 
widely and publicly recognised* Developers of a modeling program such 
as the one described above might wisely consider Girault's advice and 
Cultivate ownership among all participants* 

Caution should be exercised that model teacher education programs 
not be considered the only dissemination device* Clarke (1971) made the 
following observation with tespect to model teacher education programs 
Cunded by United States Office of Edtication* "None of the pro^jrams planned 
teacher education as something whose beginning and end were in the instl^ 
tutlon'^ <p* 127) * Likewiset possibilities for implementation of teaching 
strategies Into programs of professional organlaationst inservlce programs 
in public schools^ sCate departments of education, and other institutions 
beyond the university should not be overlooked* 



Cte livery Sya tern Developmenj^ 

What was the case for innovaCion in school mathematics might equally 
be valid for mathemacics teacher education innovation* The textbook by 
Cooneyt Davis » and Henderson (1975) which contains classification systems 
of moves used in teaching mathematical concepts^ generalizations » and 
skills should serve textbook needs in mathematics education programs 
initially* Implementation might be fuiCher assisted by development of 
materials which enhance the preservice teacher^s ability to observe these 
moves in classroom settings and emulate these moves under controlled 
conditions* Materials designed to develop observational skills (protocol 
materials) and teaching skills (ti^aining materials) might include concise 
overviews of the classification systems* They could be illustrated with 
examples, concise lessons in which many of the moves £ire sequenced into 
a strategyi and realistic depiction of classroom settings* 

There is evidence of the effectiveness of protocol and training 
materials similar to the ones suggested for development in mathematics 
education* Bi^own (1974) has written: 
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For several years, those of as who have devoted much time and 
energy to the creation of protocol and training materials have 
been operating on the basis of relatively untested assumptions* 
For example, there is the assumption that- protocol materials in 
fact lead to the acquisition of meaningful, usable concepts* 
Sim.ilatly, chere is the asfjumption that training materials lead 
to the acquisition of teaching skills which are likewise meaning* 
ful and usable* Both of these assumptions now have some 
Supportive data* More centrally, however, there are the 
assumptions that protocol and training materials lead to differ'* 
antial outcomes and chat given a teaching skill for which there 
is a strong conceptual base that the combined effects of pro- 
tocol and training rnaterials are additive* (Foreword) 

The Winter 197^ issue of Journal of Teacher Education is devoted to a 
discussLon ^nd justification of the place of protocols in teacher educa- 
t LOn programs * 

Jlelivery system rese^irth could be planned almost immediately on the 
effectiveness of the protocol and training materials whose development is 
suggested in this paper* This research would be component research and 
would be classified even more specifically as delivery system research 
of the type Brown summarised* In fact, Cooney , Kansky, and Retzer (1975) 
have made case for development of protocols on strategy moves for 
teaching mathematics* They identified moves which might be best to 
initi^tlly portray* 

A crucial question arises as to how the development of a delivery 
system can be financed* Regardless of the source of support for the 
needed development, the resultant research can provide a more rigorous 
evalu/ition of the protocols developed than the *subjective evaluation 
commonly used with retent program development projects* 



Context of Delivery System Research 

Delivery system pilot studies could begin almost simultaneously with the 
building of model teather education programs* These pilot studies can 
provide formative evaluation of the protocol and training materials being 
developed* They can also help identify research variables, criteria, and 
other elements of research design used to test the effectiveness of 
delivery systems. Since this subsequent delivery systems research is one 
kind ot research on teacher education programs, a literature search was 
made to determine relationships among proposed validation and delivery 
system research and prior research in teacher education* One outcome of 
this search is a perspective of the kinds of research on teacher education 
programs, and an irtdication how delivery system. research and validation 
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studies iire related to them. There is an indication Chat delivery systems 
research and valldecioti studies should be able to proceed in ^ friendly 
environment because the concerns of these kinds of research are similar to 
that expressed in the broader literature. Finally, the literature provides 
some challenges and specific things to consider as mathematics educators 
design their delivery system research and validation studies. These are 
examined more fully in turn. 

The research literature sampled indicates that there are essentially 
three positions used In evaluation of teacher education programs* One 
can study the effects of a component of a program or of the entire pro- 
gram. Others take the position that research should evaluate a teacher 
education program by studying the teachers produced by It. This type of 
research seems equivalent to studies on teaching effectiveness and teach- 
ing evaluation. Thus, one exploring the educational research context of 
delivery system research cannot help but explore the context of validation 
studies as well. Figure 2 provides an outline of this perception as Vfell 
as a basis on which to subsunie suggested research in the teaching strate* 
gies movemeut. With respect to Figure 2, a position of this paper is that 
anticipated delivery system research can be STibsumed under either compo- 
nent or comprohensive research* Expected validation research can be 
viewed as a subset of research on effectiveness of teacher actionSt l*e., 
research on the products of teacher education programs. 

Later cOTnptehen=;lve delivery system research on teaching strategies 
can be undertaken when a suitable design has been established. Finally, 
with respect to Figure 2, we note that small scale validation studies 
are elements of the set of studies of teacher effectiveness. 



^Component ^ 

Research on ^^^^.^---^''^ Deli very System Research 

Teacher Education'^ ^-Comprehensive^^-"''^ 

Programs — .^^^ 

^"^Produt^t^ Validation Research 

Figure 2 

Developing a Research Program on Delivery Systems^ 

Highlights of a proposed sample delivery system will be outlined, and 
some aspects of pilot delivery research models will be considered. Mathe* 
maticii educators are challenged to contribute to the development or improve* 
ment of this delivery system and subsequent research or else to develop 
contrasting delivery systems and plan research using them. Next the 
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literature on research on teacher education programs and teacher effec- 
tiveness is eicamined to determine what justification eicists for delivery 
system research and to determine some of the challenges to be faced. 
Sotne suggestions are m^de for evolution of future delivery system models, 
and some justification for subsequent large-scale validation research is 
considered* 

A Delivery System 

It is presumed that all validation and delivery system research coor-^ 
dinated by the Georgia Center will have cotnraon reference to the classifica^ 
tion systems of moves for teaching matheTnatical concepts* generalizations 
or skills which appear in Cooney, Davis, and lienderson (1975). This pre- 
sumption Is made not to inhibit the originality of researchers but to gain 
the advantages which can accrue from a concentrated and coordinated research 
effort with a common frame of reference. The sum total of research results 
from the various projects should contribute substantially to the research 
literature on teacher effectiveness and teacher education system effective*" 
ness* Such a common frame of reference should also help clearly delineate 
the nature of the research treatments. The classification systems taufiht 
are empirically based; they categorize what mathematics teachers actually 
do as they verbally deal with mathematical content. This approach clearly 
contrasts with classification systems of teacher actions based on a 
Philosophy of education or a psychology of learning* It also contrasts 
with teacher actions which are nonverbal or are related to Interpersonal 
relationships or classroom management functions of teachers* Hence* it 
is Suggested that a delivery system contain these classification systems 

moves together with the protocol and training materials necessary to 
enable preservice or inservice teachers to attain the ability to observe 
and use these moves . 

A suggested perspective for this sample delivery system is that 
teachers should be trained to be observers of classroom interaction as 
well as directors of the verbal manipulation of mathematics content* 
Observing and using strategy moves are pedagogical skills * Hence* they 
should be taught using a delivery system which uses such skill strategy 
moves as interpretation* demonstration, and guided practice with feed-^ 
back. 

Protocol materials are intended to develop observational skills* 
Such materials can help one Ca) develop the ability to discriminate the 
teaching of mathematical content from other aspects of classroom inter- 
action; Cb) distinguish among the teaching of mathematical concepts* 
generalizations, or skills; and (c) identify sequences of moves. It is 
suggested that the following protocols be prepared for use in developing 
observational skills: 
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1, .a protocol which gives examples and nonexamples of teachers 
dealing verbally with maChematical content and which 
establishes chat a Ceacher, a student, a text, an activity 
card, or a multi-media presentation can each convey subject 
matter and, hence, make teaching moves; 

2, a protocol which identifies the teaching of mathematical 
concepts, generalisations, or else skills as contrasted with 
other types of mathematical subject matter such as facts or 
values; 

3, protocols which depict the major categories of moves for 
tetiching mathematics- — such protocols should be prepared for 
each content category — concepts, generalisations, and skills; 

4, protocols providing an illustrated overview of each move in 
each of the strategy move classification systems; 

5, a number of protocols which are designed to provide enough 
examples of individual clusters of strategy moves that one 
might expect the user to attain proficiency at identifying 
the moves exemplified; 

6, a sufficient number oC concise pnathematical lessons depicting 
the sequencing of as many moves as possible from each classi- 
fication system Into appropriate teaching strategies to 
exemplify each move in the three classification systems; 

7, a sufficient number of protocols depicting realistic sequencing 
and pacing of strategy moves to exemplify each move in the three 
classification systems (Such protocols could be used In practice 
sessions as alternatives to live classroom observation. They 
would depict content strategies which are sequential, nested, 
and overlapping, and which ate intermingled with such things 

as teacher managerial or disciplinary functions.); and 

8, protocols, similar to ones identified in 5, 6, and 7, to be used 
in evaluating the extent to which teachers have developed 
observational skills . 



The preservice or inservice teacher could use the^ above protocols to- 
gether with supportive printed matter in order to learn the classifi- 
cation systems and receive guided practice with feedback on the skill 
of Identifying strategy moves. 

In using tha delivery system with preservice teachers, emphasis 
might be placed on attaining observational skills related to pnonltoring 
their own teaching and identifying strategies used by authors of textual 
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and resource matGTials {as thsse activities relate to the selection of 
texts or activity cards). One might also stress using moves in basic 
lesson planning, microCeaching chose lessons, and writing test Iteins. 
On the other hand, experienced teachers might be asked to sharpen their 
teaching skills by guided practice in adapting lesson plans when the 
classroom situation calls for it and in communicacing with other teachers' 
suggestions for teaching alternatives and for improvement of instruction. 
For both preservice and inservice teachers, one could emphasize the 
observational skills that would enable them to monitor the content of 
their own lessons as well as provide a cognitive description of the con-- 
tent manipuLation in the class of a colleague or student teacher (as con- 
trasted to the more typical affective or evaluative descriptions which 
result from observation). 

Formative evaluation needs to be done during the development period 
to help determine the proper combination of multi-media used in making Che 
protocols, Observirg and using strategy moves are pedagogical skills, and 
it is unlikely chat the p^^inted media alone can best porC^-jy these teaching 
moves. In some cases where verbal interaction is the primary focus, 
audiotapes may be adequate. In reconi years^ protocol materials have been 
developed in slide-sound, video-tape» Sirnn movie» and 16mm movie media* 
Interested researchers shCfUld acquaint themselves with Che advantages and 
disadvantages of varior,s multi-media formats and develop the best possible 
protocols consistent with the level of financial supporC available. 

The delivery system described could be used with preservice teachers 
in the mathematics methods course which is common to all secondary teacher 
education programs or else with inservice teachers in short courses^ work** 
shops, or extens Um courses . 

Smith (1971) characterized a teacher education program as follows: 

Specifically rhen, any adequate program of teacher education 
provides for (1) training in skills, (2) teaching of pedago- 
gical concepts and principles^ (3) developing relevant 
attitudes and (^) teaching the vajrious subject matters of 
instruction, (p. 2) 

The delivery system described would be an integral part of training in 
skills and would be used in conjunction with the other components listed* 
Smith continued : 

A major breakthrough in the training of teachers occurred when 
teaching behavior was conceived to be a complex of skills thac 
could be identified and practiced systematically under specifi- 
able conditions. (McDonald and Allen, 1967) This conception 
probably arose from advancements in technological devices for 
recording and reproducing behavior. . . *Along with this 
breakthrough came a new emphasis in the ar.alysis of teaching 
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behavior, , . , These two points of view — that teaching behavior 
should be analyzed in tetms of the psychology of learning and 
thac it shotild be studied In its own tight — are not contradict 
tory, as is often claimed, but complementary, (pp- 2-4) 

The perspective that teaching behavior should be analyzed in its own 
right gave rise to various classification systems of moves. 



Delivery System Pilot Studies 

Pilot studies on the effectiveness of delivery systems are needed. 
Work in teaching strategies is sufficiently new that cooperating researchers 
need time and experience to identify criterion variables, gain experience 
with alternative treatments, and wrestle with philosophical considerations 
of appropriate research designs. Pilot studies could be done with pre- 
service te,ichers and simply test to see if they have achieved desired 
levels of ability to observe and use strategy moves. One option in such 
a study would be to follow these teacherr* through initial years in the 
profession to see if use of these skills is apparent. Pilot studies could also 
be conducted with high school supervisors of student teachers to see if 
strategy moves are useil in observing and communicating with student 
teachers. Pilot studies need not be restricted to teacher education insti- 
tutions. Mathematics supervisors working for state departments of edu- 
cation could use a delivery system with department chairman or other 
administrators. An effort also could be made to determine if strategy 
moves are helpful in evaluating teachers. 

Many teacher training institutions are moving toward competency- 
based teacher education programs. However^ most professional teacher 
organizations have consistently opposed competency-based certif Icat ion^ 
performance-based reward systems, and accountability requirements. This 
opposition seems to be based upon a mistrust of the qualifications of 
those that judge and upon the common knowledge that many factors other 
than teacher performance affect achieveinent of the learner. Delivery 
system pilot studle;; might indicate whether it is feasible to consider 
offering a counterproposal chat evaluators be required to reach a speci- 
fied level of observational skill on those competencies agreed to by 
teachers. This would be an alternative to being held accountable only 
in terms of pupil achievement. 

Several challenges among cooperating researchers are readily apparent. 
The construction of delivery systems is one. Another is adapting a 
given delivery system to one*s own need. It would seem that cooperation 
in developing a delivery system and modeling it in varied contexts 
represents a worthwhile challenge. In addition, delivery systems 
research designs must be established. Both development and subsequent 
research are necessary to maximize information and to warrant subsequent 
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large-scale validation studies on the effectiveness of various strategies*. 

Although it would be desirable to have cooperating researchers work 
with similar delivery systems for the training of secondary mathematics 
teachers* adaptations might be easily made for delivery systems research 
with mathematics teachers at other levels*. Similar delivery systems could 
be used with preservice or inservice community coiiege teachers as a part of 
Doctot of Arts or Ph,D, programs. The effectiveness of the delivery 
system in this context could be tested further*. Adaptation of the 
delivery system for elementary school mathematics teachers might be con-* 
sldered^ Since the elementary school teacher has less opportunity than 
the secondary teacher to become familiar with types of mathematical con- 
tent, delivery systems for elementary teachers might help them develop 
proficiency in observing and using the major categories of moves in the 
classification systems. 



Results of a Literature Search 

Rosenshlne and Furst <1971) have suggested that development and 
research on delivery systems contribute to the study of teacher effec- 
tiveness. The work of Cooney, Davis^ and Henderson <1975) now makes such 
study possible, Furtherraorej their classification systems enable us to 
define strategies using specific denotable behaviors — a condition that 
had not been met when Rosenshine and Furst made this suggestion*. Rosenshine 
and Furst further suggested; 

Perhaps the next seep In increasing control in process-product 
studies would be to stabilize the teacher's behavior through 
training so that the observed behavior would be a more accurate 
reflection oE the teacher's intentions and/or the Intentions of 
those who prepare the Instructional material. Curriculum 
developers and teacher educators would have to work together on 
this problem. Without such cooperative work we may continue to 
have curriculum experts developing instructional packages without 
clearly specifying teacher behaviors and teacher educators training 
teachers in teaching skills without clearly specifying the 
instructional situations in which they will be used, Cp, 62) 

Using a delivery system of the kind outlined should certainly "stabilize 
the teacher's behavior through training*.'* Tiie interrelatedness of 
teacher actions appropriate to teaching specific mathematical content 
should permit u3 to do research in which both the content to be taught 
and the expected teacher behaviors are clearly specified. 

An indication of the potential value of the subsequent large-scale 
validation studies is that they may provide information which Turner 
(1971) indicated Is needed. 
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A recent experiment by Nuthall (L968) indicated that although 
a pLTTticular maneuver or strateg;' of teaching may facilitate 
the learning of one particular concept, it may not facilitate 
thii learning of another. Thus the consequences of particular 
maneuvers arc at present hard to predict since they interact 
with the substantive topic. Nonetheless* the way in which the 
teacher maneuvers within a particular topical venture may be 
regarded as potentially critorlal for the assessment of teacher 
performance J although substantial work remains to be done to 
specify relationships between particular kinds of maneuvers and 
particular types of ventures in specific subject areas, 
(p. 23) 

Research literature reflects an increasing dlsench^intment with find- 
ing an association between teacher performance aud personal/social 
factors such as those measured by the Ryans^ Te ^ iuher Characteristic 
Schedule or the Minnesota Teacher Attitudes In \ entory (MTAI) , Indica- 
tions of this have been given by turner <1971) and can be seen in the 
following quote from McNeil nnd Popham (1973): 

The single most important deficiency in research on teaching 
effectiveness is the failure to use outcome measures as a 
criterion and, instead* to rely upon a priori meas'vres of 
^ teaeher^s personal attributes such as his personality 
or education* his back£round> or the measures of instruc- 
tional processes such as his instructional strategies or 
his verbal behavior in the classroom. Wh^in one considers 
the idiosyncratic background of teachers and pupils* the 
great range in typical Instructional objectives* and the 
Immense variation in t?ie environments where teaching occurs 
it is unlikely that any processes or personal attributes on 
the part of teachers will invariably produce pupil growth 
. , , Systems for guiding the observations of teachers and 
pupils interacting are legitimate tools for obtaining a 
more accurate account of what is taking place during 
the teaching act, (pp, 220-221) 

The classification systems in the delivery system described earlier should 
enable researchers to obtain an accurate account of the teaching act for 
research purposes. 

Thus* there are preliminary indications that an evolved delivery 
system rese*irrh dosign can provide a basis for improved educational re- 
search. It provides a framework for the study of teachers' actions (as 
contrasted with attributes). Further, it contains a clearly specifiabJe 
and observable set of moves from which one can sequence moves in order 
to study the relative ef Tec tivcness of strategies which are bound to 
mathematical content. With this in mind, it might be profitable for 
cooperating researchers to further examine the historical research context 
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which delivery systems research and sobseqoent large-scale validation 
studies would build upon and contribute to. 



Challenges in Structuring Delivery System Research 

Among the considerations which are crucial to evolution of research 
designs for deljvery systems research and subsequent large'-scale valida-- 
tion studies ar^ (a) Che "can do/will do'' phenomenon which appears in 
teaching, (b) differences in perspectives on what constitutes teaching 
behavior, (c) desirability of student learning as a criterion variable, 
and Cd) the philosophical quandry aboui. Che relationship between teaching 
and learning* These are examined in that order* 

An initial problem confronting researchers will be to show that a 
preservlce teacher cqn perform teaching moves in a sensible sequence. 
Another type of research would be to Incorporate treatment as a part of 
a total preservic*; Leacher education program and determine if teachers 
wllj^ use strategies as defined by teaching moves* One could use as cri- 
terion variables preservlce micro teaching performance, teaching acts 
of the Inservice reacher, or else something related to student achieve- 
ment . 

The search for criterion variables is a challenging and serious one. 
A dx;!Slgn In which presetvlce teachers are expected to demonstrate that 
they can perform certain strategy moves would utilise a concise and 
manageable criterion variable. Studies using such a criterion variable 
should be done to supply an existence proof that one can train teachers 
to use teaching moves* 

There Is a nagging conoern about the value of such a criterion 
variable* If such research v/ere proposed In K-12 mathematics rather 
than in teacher education In mathemacics^ the corresponding treatment 
would be teaching a mathematical skill » and the corresponding criterion 
would be a demonstration ot student achievements Because so many mathematics 
education experiments on elementary and secondary curriculum during the 
development of "new math" currlcular materials provided evidence that 
students can^ learn various concepts, principles and skills of mathematics 
at various levels, Bruner was Inclined to enunciate an axiom paraphrased 
cis, '^Any subject matter can be learned at any level provided It Is put 
in appropriate form/' To what extent this presupposition can be generalized 
to teaching skills at the college level with preservlce teachers is^ a 
ctuestion the potential researicher will want to wrestle. 

I 

If» on the other hand » t^e criterion measures are related to observ- 
ing a trained teacher within a few years after he has received his train- 
ing» we have Implications of both positive and negative results to weigh. 
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Positive res^ults would indicate that a teacher ulio was taught moves within 
strategies far teactiing mathematics coacftpts, ptincipleSi or skills not 
only can, but will, use them in teaching matheniatics , One woj^ld Uave to 
structure his design so as to tell, if possible, whether this teaching per- 
formance was becatise of training in using strategy moves or in spite of 
such training. In the latter case, the use of the mc^ves may be the result 
of unconsciously doing what seems to be appropriated—the kind of appropriate 
teaching which produced the classification systems in the first place* 

If after a few years, teachers were not using sLrategy moves, how- 
ever, additional questions would be raised^ It is a well-known fact in 
human behavior that what people will do in an unstructured free choice 
situation is considerably less than what they can do in a structured 
situation where certain kinds of performance are expected of them. Without 
adequate data to predict a "usual" can do/will do loss, inadequate perfor- 
mance of teaching moves would be difficult to attribute to inadequate tea- 
cher effort or to an inadequate training program. 

The question of a conceptualisation of teaching is also a challenging 
one because it relates to treatment variables* Smith (1971) identified 
p perspective for research on teacher education and related controversies* 

What is research on teacher education? In a sense this question 
is naive, for everyone must know alreads' what teacher education 
is and that research on it is simply the systematic study of 
problems chat arise in the course of carrying it on. Generally 
speaking, research on teacher education attempts to answer the 
question of how the behavior of an individual in preparation for 
teaching can be made to conform to acceptable patterns, . , , 

The various conceptions of teaching have given rise to theoretical 
controversies, which in turn pose the question of how teaching is 
to be conceptualized for research purposes, , . Despite all our 
efforts, we apparently have no generally accepted conceptual 
system, psychology or otherwise, by which either to formulate 
or to identify the skills of teaching* Fortunately, the lack of 
such a system does not preclude research* r - - On the other 
hand it is clear that research would be advanced measurably by 
a conceptual system for formulating and idenrifying teaching 
skill. <pp. 2-4) 

Several authors nilght be cited which relate to Smith's perspective. 
Teaching behavior is a central focus in solute model teacher education pro- 
grams, Johnson, Shearron, and Stauffer (1968) made the following 
observations regarding this focus , 

Gem's [Georgia Education Model] position Is that the teacher 
education program should be designed in relation to tue job 
the teacher is required to perform in the classroom, Ky 
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defining what che job actually is, the conipetencies necessary 
to perform specific tasks may be adequately determined. 
other vords, it would logically follow that the content of a 
teacher edttc^ition program should be base<l on the teaching 
act itdelf. <p. 5) 

There are contrasting cpitiions on how teaching should be characterized 
for research purpose. Greei^ (1971) used the method of analytic philo- 
sophy to conceptualize coaching. He stated: 

In order to find out vhat teaching is by observing someone 
doing it, we need to know what teaching is already. . . . 
tn analysing a practical activity like teaching, the aim is 
not to invent some new concept or idea of teaching, nor even 
to specify what people ought to mean by "teaching.'* The 
objective is rather to study, clarify, and more thoroughly 
understand the idea of teaching that we already have. (p. 3) 

Johnson, Rhodes, and Rumery <1975) noted that no acceptable conceptual 
system exists for characterizing teaching: 

The current approaches to the evaluation of teaching can 
be grouped in three broad categories: <1) measurement of 
learning outcomes presumed to be the result of teaching: 
(2) measurement of teacher characteristics presumed to 
facilitate learning or the attainment of other possible 
educational goals; and (3) analysis and measurement of 
relevant categories of pedagogical behavior. In the 
sections of this essay that follow, we vill attempt Co show 
that these three approaches to the evaluation of teaching 
have "reached a dead end," not because they have been tech- 
nically misapplied but because they are fundamentally mis- 
directed. However, all three of these ^approaches alao 
share two basic problems: (1) the absence of adequate 
theoretical development or integration and (2) the confusion 
of measurement with evaluation. <p. 176-177) 

It is this ^^absence of adequate theoretical development or integration" 
that offers mathematics educators an opportunity to contribute to a 
theory of teaching which can clearly enunciate a position on its con- 
ceptualisation . 

A third consideration relates to the desirability of student learn- 
ing or student gains as a criterion variable. Feck and Tucker <1973) 
wrote: 

One loag-needed methodological advance is btrginning to appear 
in research: the use of pupil-gain measures as the ultimate 
criteria of the effectiveness of any given process in teacher 
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education. Thesa Include affective and behavlotal gains as 
well as gains In subject niastety. Cp^ 943) 

Rosenshine and Furst (1971) used "ptocess-product studies'* to describe 
research whose criterion is what Peck and Tucker described as *'long-needed 
methodological advance* . , pupil-gain measures." They cautioned; 

The results of process-product studies must be treated with 
caution because these are correlational, not experimental* 
studies* The results of such studies can be deceptive in that 
they suggest causation although the teacher behaviors which 
are related to student achievement may be only minor indica-- 
tors of a complex of behaviors that we have not y^c identi- 
fied, (p. ^3> 

Yet Rosenshine and Furst seemed Co encourage a continued investigation of 
the relationship between teacher behaviors and consequent student learn-" 
ing in Che following Passage: 

The descriptive behavioral data obtained from these classrooms 
studies is then compared with what educators believe "should'* 
occur in classrooms. Teacher training then becomes a procedure 
for closing the gap between the behaviors which ^ occur and 
the behaviors which educators believe sh o u 1 d occur by training 
teachets in the desired behaviors. * ..Unfortunately, the rela- 
tionship between the teacher behaviors advocated by educational 
experts and the consequent learning by students has not been 
thoroughly investigated. (p. 39) 

McWetl and Popham (1973) gave some indication of the widespread accepta- 
bility of student learning as a criterion variable by stating: 

A focus on pupils reveals far more about the effectiveness of 
teachers than does direct study of teachers themselves*. . * * 
Support for the position that the ultimate criterion of a 
teacher's competence is his impact upon the learnet has been 
offered by a number of individual researchers aa well as 
professional associations, (p- 218) 

But McNeil and Popham (1973) also gave js a hint of the difficulties in 
accepting pupil learning as the chief criterion of teacher effectiveness. 

But reservations in accepting pupil change as the chief 
criteria of teacher effectiveness have arisen both from 
technical problems in assessing learner growth and 
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from philosophic considerations. Chief atnong the former 
are concerns about the adequacy of measures for assessing 
a wide range of pupil attitudes and achievement at different 
educational levels and in diverse subject*matter areas* 
* » » failure to accotint for instructional variables that 
the teacher does not control, . . .and unreal lability in the 
results of teacher behavior* that is* inconsistent progress 
of pupils under the same teacher. * » .Philosophic differ-- 
ences, of course, underlie questions about the selection 
of. desirable changes to be sought in learners^ (p» 220) 

Let us examine one such philosophic difference. Johnson* Rhodes, 
and Rutnery (1975) asserted that measurement is confused with evaluation^ 
These authors indicated that the use of the term "evaluation" seems to 
imply the requirement of a normative theory since value jtJdgments are 
necessarily involved. They pointed out that the common use of the 
word ^'measurement^' is essentially descriptive* not formative * Thus , 
a crucial aspett of evaluation of teaching is the establishment of the 
relative worths of alternative outcomes. Researchers should make the 
value system upon which they base teacher evaluation explicits 

Johnson et al. (1975) also examined and refected several possible 
connections between teaching and learning* 

The logical basis for the use of measures of student attain- 
ment as either proximate or ultimate criteria of teacher 
effectiveness seems to be represented by the hoary slogan 
if the student has not learned* the teacher has not taught or 
as is sometimes succinctly stated, "no learning* no teaching/' 
(p. 179) 

They claimed that the logical basis for the criterion of student attain- 
ment is the cont raposi ti ve of ^'Teaching implies learning^^' This would 
be a false implication if we will admit to a situation where teaching 
does take place with learning not taking placet We would want to reject 
teaching as a sufficient condition for learning. Elementary logic texts 
warn students not to identify "implies'^ with "causes/' While "Teaching 
causes learning,'^ is a relationship to be considered* we would probably 
want to reject it on the same basis for which we reject ^'Teaching Implies 
lea rning/' 

Johnson et al » (1975) seemed to make the logical error of reconstruc- 
ting "If a student has not learned, the teacher has not taught.'^ as ^'Teach- 
ing has occurred if and only if learning has occurred^*' Apparently, they 
then rejected the resulting equivalence with a plausible exaraple of learn- 
ing without teaching (which* incidently, would better falsify the proposition 
"Learning implies teaching'' but which adequately falsifies the equivalence). 
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Johnson et al, (1975) cbaracterized Dewey's position in How We Think 
(1910) as suggesting that teaching and learning are correlative antl com- 
parable to buying and selling. But they Insightfully pointed out that 
nothing bought has not been sold. It is unreasonable to assert that 
nothing learned has not been taught. They admitted that; 

There Is an admittedly plausible sense of which if we do not 
intend that students learn as an ultimate consequence of 
what we call teaching activity, then to engage in teaching 
would be odd behavior indeed. But buying and selling have 
a similarly loose sense. It ts plausible to say that in 
the market there are buyers and &eller& who cannot always 
buy or sell even though this is what they intend. Both 
teaching-learning and selling-buying lack precisely that 
necessary connection which they must have if we are to make 
warranted inferences from one to the other as evaluation by 
outcome purports to do, (p, l8l) 

Another possible connection might be on statistical rather than logi- 
cal grounds. According to Johnson et al,^ "teaching may be considered 
effective to the extent that it increases the probability of specified 
learning outcomes'* (p, lS2) , But this belief must be subjected to the 
test of showing that other alternatives to the observed learning are 
less plausible or probable^ e,g,> cheating* 

Enough literature has been examined to question the criterion of student 
learning* It Is hoped teaching strategy researchers vfill give some attention 
to this question also. 



Future Directions for Delivery System Research 

Once philosophical and design questions have been settled and 
effective strategies are identifiedj observational schemes could be 
enlarged to include aspects of classroom atmosphere and interaction 
oChsr than content manipulation. Current studies have focused only on 
content manipulation as defined by teaching moves, Rosenshine and Furst 
(1971) pointed out that current observation instruments do not record the 
context of the teaching actf for example, assignments students wrote or 
the physical environment of the room* They suggested that observation 
Instcuments be modified to record a distinction between a teacher's aca- 
demic directions and disciplinary directions and a distinction between 
a simple repitition of a student's statement and a teacher's sutmnary of 
it. Furthermore, they suggested it may be interesting to study time or 
frequency as the analytic unit, Rosenshine and Furst (l97l) also suggested 
the desirability of having instructional periods ranging from 15 minutes 
to 10 one-hour dally lessons. Such periods may allow researchers to 
better focus on specific aspects of the teaching act such as explicating 
new material or contending with classroom management problems. 
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Evencually, research on entire teacher educaciort programs should be 
conducted. Clarke (1971), in a review of research on teacher education 
programs, noted the immense complexity of variables in such research. 
Some of these variables (referred to as presage variables^ ) include 
decisions which precede the design of programs, the contexts of prograins, 
cybernation or self-corrective devices, or the question of who controls 
the program, tho nature'and extent of the boundaries of teacher education, 
and selection procedures- In iiddition to these presage factors, Clarke 
also identified produce factors- Clarke made the following observation 
with respect to product factors they relate to research in teacher 
education programs - 

The product ftictors, or teacher behaviors to be produced, were 
specified in many of the sources reviewed- Designs to evaluate 
these behaviors were not, on the whole, well-developed, with the 
exception of one model teacher education program- Evaluation 
and feedbtick on the process of teacKer education changes still 
need to be made in the individual candidate's behavior, while 
evaluation and feedback on the product call for corresponding 
activities in the light of the candidate's performance in the 
field, (p- 153) 

In summary Clarke noted thiit 

the prospects for research on teacher education programs are 
bright- The Models have provided considerable development 
of theory. Modules lend themselves to niicro research- There 
is a ferment of activity in teacher education- The most 
difficult area is research on the total program in terms 
of success in the field- It is suspected that studies of 
this nature often remain unpublished- (p- 154) 

The lack of comprehensiveness in designs of the models was pointed out by 
Clarke as follows: 

The common complaint is that the content and treatment are 
too frequently designed to prepare the student for further 
study of the disciplines- {p- 125) 

Considerably less than half of the designs are proposali^ 
for the preparation of teachers reviewed includes 
serious consideration of the integration of the general 
education, subject matter ^ind related discipline components 
into a total program of teacher education- {p- 127) 

Finally, we return to the thought that a desirable outgrowth of 
delivery systems research is the training of an adequate number of teachers 
for large-scale validation studies. These kinds of studies have justifi- 
cation in recent research literature- 
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Rosenshlne and Furst (1971) pointed out weaknesses in some of the 
mote recent subject matter studies and made a suggestion. 

We nee^i studies in which <1) the teacher is the statistical tjnlt 
of analysis; (2) teachers or classes are randomly asigned to treat- 
ments (3) observational data are obtained on the fidelity c>f 
teacher behavior to experimental or contrast treatment and on 
the behavior of the stu^ient, while similar observational data 
are obtain^id on events in the classrooms of teachers who follow 
the t^ormal procedures; and (4) student perfortnance is assessed 
by a variety of end-of-course tests^ - Such studies are rare. 
To date, we have found no more than ten studies which satisfy 
all four criterion. The scarcity of such studies is not surprising 
because conducting them involves enormous problems of methodology, 
administration and teacher training. (pp. 41-42) 

Their suggestion helps justify the goals of large-scale validation studies 
and comprehensive teacher education deliveT7 system studies suggeste^i in 
this paper* 



Summary 

The structure and major points of this paper could be summarized as 
follovfs* An attempt was made with the fable of the Utopia States to 
establish, by analogy, a perspective of the strategies for teaching mathe- 
matics movement — both its concern and its current status. Agreement on 
concerns and status is a prerequisite for future cooperative efforts In 
research. 

At appropriate stages, research needs to be of two types: validation 
studies and delivery systems studies . The validation studies are research 
on the effectiveness of strategies which are described In terms of the 
Cooney, Davis, and Henderson (1975) classification systems of moves. A 
decision aeeds to be mde as to when a sufficient number of vali^iation 
studies have been done to warrant moving toward delivery system research. 
Delivery system research would incorporate strategy moves in a mathe- 
matics teacher education program and do research on the effectiveness 
of the resultant teacher education program. Prerequisites to delivery 
system research are the implementation of strategy moves into teacher 
education curricula and the development of components of that delivery 
system which caii facilitate this implementation^ The literature on 
teacher education programs iiidlcates that implementation of teaching 
strategy moves need not wait until a complete set of validatioii studies 
are completed. Curreiit teacher education progra^ns generally are based 
on subjective judgments of teacher educators rather than on components 
which have been shown effective by research. Modeling is suggested as 
a dissemination device. Implementation, program development, and 
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modeling are seen as p rerecjuisl tes not only Co research in ceEichetr 
education but Larger validation studies where research populations can 
be. teachers tather than students, 

^n attempt was made lo present a picture of the larger context into 
which validation snd delivery systems research would fit by sanipling 
pertinent literature on the effectiveness of and evaluation of teaching 
as well as research on teacher education programs^ A sample system was 
described , and the nature of pilot studies on its ef fectiveiiess was 
explored. Good teacher education studies are relatively recent 
delivery system research on strategies for teaching mathematics should 
be a welcome addition to rhat research — if one can judge by the concerns 
and suggestions of reviewers of current research. 

Challenges related to research design were examined. One type of 
teacher education research attempted to determine if teachers can perform 
as they are instructed* The question was raised concerning the value of 
similar research with respect to performance of teaching strategy moves 
and concerning research which will detnonstrate what teachers will do as 
conrrasted with what they can do. The absence of an agreed conceptual 
framework on the nature of teaching upon which to base research was noted, 
Tlie promise as well as the reservations about pupil gain measures as 
criterion variables of teacher effectiveness were examined. The question 
of the relation between teaching and learning vas raised because of the 
attention the literati.ire has given to learning as a criterion variable on 
validation studies. 



To help us determine (a) the accuracy of the perceptions expressed* 
(b) the desirability of the goals outlined, (c) the validity of the 
suggested secji^ential order of the tasks in a cooperative effort, and 
<d) the adequacy of coverage of challenges in developing appropriate 
research designs, the following discussion questions are offered* The 
hope is that discussion of these points can help the coordinated efforts 
necessary to forward the movement on strategies for teaching mathematics, 

1h Does Che Utopian fable represent an accurate analogy of the status 
and concerns of the researchers in the strategies for teaching mathematics 
movement? 

2, What kind and amount of evidence from validation studies would 
adequately justify structuring teaching by explicitly using strategy moves? 

3, is delivery systems research needed concurrently with additional 
validation studies? 

^, Are implementation efforts necessary prerequisites to desired 
delivery systems research? 
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5. Does establishment of model teacher education progr*inis offer the 
n»ost promise for dlssemiaatl<ja efforts? 

6. Is development of protocol and training materials a necessary or 
desirable pact of implementation and dissemination efforts? 

7* Would studies establishing whether preservice teachers can use 
strategy moves be a valuable type of delivery systems research? 

8* Ac vhat stage should delivery systems research be designed vhlch 
observes what teachers trained in using sttategy moves actually cio in the 
mathematics classroom and the resultant effects upon their students? 

9* UhaC should be the role of researchers on teaching strategies in 
development of protocol and training materials and in persuasive writing 
vhich could be used in dissemination efforts? 

10. Should the strategies for teaching mathematics components of reacher 
education programs be the only ones tested in delivery systems research? 
Should research be designed which tests a comprehensive teacher education 
program taking into account such things as mathematics coitrses » education 
courses* and influences of other agencies such as professional organizations* 
state offices of education » and certification boards? 

11* Which of the following should dissemination efforts be directed 
towardt teacher education instituti ^^nsj departments of mathematicst 
departments of mathematics educatio^v^ departments of education, offices 
of state superintendents of public ti^s t rue tion^ teacher certification 
boardSt or professional organiJiat io,.x in mathematics education? 

12* Wliat is the relationship between teaching and learning» and how can 
anticipated research contribute to knowledge of tUat relationship vltbout 
falling into possible pitfalls of prior rese.^rch? 

Discussion of these points may help us in organizing and coordinating 
our research efforts* 

Let us begin the immediate tasks of developing a teaching strategies 
delivery system, implementing it in several teacher training institutions 
while simultaneously doing pilot studies on its effectiveness* Only then 
can ve supply enough teachers to do the needed large-scale validation 
studies and subsequently produce adequate delivery research designs* Let 
us accept a challenge to cooperate in these tasks which can contribute 
to a theory of teaching and to estahlish a firm basis for the education 
of mathematics teachers * 
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The Materials of Teacher Training 



David Gliessinan 



Indiana UnLvcrsity 



In the vocabulary of t>is monograph, the task of this paper is to 
addr^iss the quest Lufi of ho^r t(^ implement effective procedures for training 
mathematics t£jacU^r^ to uat; spoci.^ied teaching moves and strategies in 
teacher educatJ^jn pr, grams. Stating the problem in this way places it 
squarely wtthin what JtetKetf in this monograph^ refers to as "tiie develop- 
tncnt of a delivery system." this ts a particularly good point of departure 
bccousp It is alar? a :irlticnl. juncture; Successful impleTTventntion ts partly 
a test ot the foresight that has been shown In developing usable trainin^^ 
r^rortjdure^j : ft such foresight has been lacking, and implementation is 
unsucccsiir 1 the mo&t e f f c c 1 1 v e training procedures arc Inconsequential. 

To bef^in with what is probably an unnecessary word of caution, there 
clearly are dlfflcuUies in Uiplcmentlng new procedures within ongoing 
Prof^ratns. In teacher education* Introducing and successfully instituting 
change is a matter about which some have hypothesized and many have despaired. 
As an example of just how intractable some feel the problem to be, an 
academic division In the author's own institution has even established a 
concentration in "Diffusion and Adoption of Innovations/' The Implication 
of that kind of action is clear; mathematics educators will not be the 
first nor the last to try to bend, mutilate, or fold the ^'delivery systems" 
that we have all helped to sustain. 

So much for the scope and complexity of the problem. Let us examine 
now one fiypothesis about 'Effecting change in teacher education that has 
guided the work of a significant number of people, historically those 
associatfjd with the audlo*-visual or instructional media area and more 
recently, content specialists themselves* Brleflyi this hypothesis is 
that the creation of new materials Is an effective way of changing the 
training Of teachers. A recent and highly influential argument for such 
"material**based training" was posed by B- Othanel Smith in his book. 
Teachers for the Real Worl d Cl969)» In this volume, he defined the need 
for two kinds of materials; "protocol materials'* designed to contribute to 
the development of competence in interpretation and "training materials" 
designed to contribute to the development of skilled performance. Even 
thou^jh certain '*mplrical evidence has blurred the distinction between 
these two kinds of materials as separate_ types (Kleucker, l97^), the 
essential argument for the necessity of new materials for training remains. 
In thid papcfi the author will pode some general propositions about the 
design and develop'^ent of materials for training, basing those propositions 
on both the psych ;togical and practical ditnensions of the problem* As the 
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implications of these proposirions are explored^ £i rncloa^ile ^/ill also 
be developed foe basing innovacioa ia training upon innovation in materials. 
In factt considerations of design and rationale will be Interwoven through- 
out. 

To a significant e?<tf^nt, the discussion in this paper will draw upon 
the work of the Mational Center for the Development of Training Materials 
in Teacher Education (based at Indiana University) and of several projects 
associated with the ProCoo.ol Materials Development prograrn- Under United 
States Office of Education funding dtjrlng the past fouv ot five years^ 
those associated with these proi<scts hnve struggled valiantly (and some- 
tines success f uXiy ) with the probler-is of eonceptuallzing^ designing ^ pro- 
duclng^ and evaluating protocol and training materials for a variety of 
concepts and ijkilla at different grade levels and in different subject 
areas. As a participant In and observei: of these efforts, the authoi: has 
developed some hypotheses^ resecvations, hunches^ and convictions that 
might well be sifted for the wheat and the chaf;f- 



Some Matteri^ of Definition 



First, we E^hould attend to a few definitions. The term 'Wterials'* 
is used tn this p^iper to refer to the full range of media including, for 
ejcample, print, motion picture, audiotape and photographic stills, the 
tartn ''matetLals for training/^ on the other hand* is restrictive. It is 
meant to refer to those materials th^jt are not primavily inforniat ional 
in pucpose, Rnther^ such materials are intended to develop certain 
functional skills ranging from observational or interpretive to perform- 
ing, tn other words^ ''materials for training*' may be designed to contri- 
butG to interpretive competence or to skilled performance or to both, tn 
terms of content, such materials are likely to confront the trainee with 
the recorded behavior of teachers and pupils. For the purpose of develop- 
ing Interpretive competence, the behavior portrayed should illustrate or 
exemplify clearly defined concepts about teaching, about learning, or 
about the substance of a content area,-'' For the purpose of contributing 
to sl^illed performance, the teacher behaviors portrayed might usefully 
illustrate specifiable teaching skills of clearly apparent utility In the 
classroom, ^ major practical outcome of this emphasis on the portrayal of 
behavior Is that many materials for training will take the form of such 
audio-visual media as film or ifudiotape. 

To further clfjrlfy the distinction between the informational and 
training purposes of materials, we might consider an Illustration from 
the field of educationfil psychology. In the social-psychological area 



Materials that successfully meet this criterion of "concept instancing'* 
are generally ttlassif iable as "protocol materials,*' 
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of thnc discLpline, technl(|ues for describing group relationships have long 
been of interest. One such technique* that of '^sociomet rics /' is a ques* 
t tonnaire**based method for ^tithering and plotting data on the status of 
individuals in a grnup. This easily gathered data yieitts information by 
means of which a teacher may locate students in such categorizes as "socia] 
lsol<^te" or *'neglec tee Many textbooks in educational psychology treat 
the soclon^etrLc tochalque In an informa t iotia L sense. They may even show 
a completed plotting of data, attach labels to given categories, and discuss 
the significance of the re.sults* No textbook of which the author is aware^ 
however, actually puts the learner through the process of ocganliiing* 
plotting* aad interpreting "raw sociometric data" although this can be fair- 
ly tiasily done* In terms of the definitloa in this paper^ textual material 
iacorporating the latter characteristics could be classified as "materials 
for training*" tt is probably safe to saV that most current instructional 
materials in teacher education are in fact in Format ional in character 
(including more than a few that are inappropriately classified as "training 
materials"). It Is this emphasis on "information giving" that might lead 
one to conclude that even many -sducatlonal films, for exfjmple* are not 
classi f iiible as "materials for training/' 



Let us turn next to the development of materials for training with 
particular reference to moves and strategies in teaching mathematics* 
Here a note of (caution is in order* '^'he development of such materials 
presents a number of conceptual* design^ and technioal problems* The 
present p*')per* however, wi J 1 concentrate on the problems of designing 
and producing m^icerials for training. The conceptual problems^ such as 
doflnin^f ^ind artiily^ing the concepts or skills to he portrayed^ are the 
business of the (;ontent specialist* In terms of this monograph^ these are 
problems for the mathemattcs educator. 

The problem of design Is one with which both the content specialist 
and the technical or media specialist must contend because both the nature 
of the conceptual area and the stature of the medium influence the design 
poss tbi I it les* Work on this tas^k might well be guided by some very 
general suggestions from the psychological literature on the acquisition 
of concepts iind skills* To the following section^ a few generalizations 
from that iiteratuie will be summarized. tn a later section^ we will 
consider some practical guidelines suggested by probable conditions of use 
in teacher education programs * 

Suggestions from Tsychology 

Three years ngo^ the National Center commissioned an educational 
psychologist* Bryce B* Hudglns^ to survey the major literature on the 
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iicquis.ltioa of coniplex skills and to draw from that literature implica- 
tions for the design of ntRterlalj to be used in the development of 
skilled performfince. Tn this section^ we will consider some n^ajor points 
from Hudgins* stxidy: a more thorough analysis Is provided in his Tnono- 
graph (Hudgins, 1974). The general recomttvendationa that he mkes about the 
development of complex skills (such as learning to use teaching moves and 
strategies in mathematics) may not seem very surprising. This is, in 
fact, a case whei*^. the implications of research are supported by a certain 
correspondence wiih common experience. 

Mudgins identifies three major stages in the development of skilled 
performance; an overview or informational stage in which the trainee 
develops a general perspective of the context in which the behavior Is to 
be performed; a practice or performance stage where he or she has the 
opportunity to exhibit behaviors^ within either simulated or actual con- 
ditions; and a "feedback" stage in which the trainee gains Information 
about the efficiency and skill of his or her performance. In the event 
that these stages seem overly general, remember that Hudgins' argument for 
their effectiveness rests upon two additional and critical conditions: (a) 
the refinement and precision with which a complex skill is analyzed for 
the component behaviL>rs to be practiced and Cb) the arrangement of extended 
and intensive rnther than occasional or incidental practice. Within this 
set of genenilisiijtions, there m^^y well be implications for the developrnent 
of skiJl in the teaching moves and strategies of mathematics. At this point, 
it is sufficient to note that the teacher trainee, according to this train- 
ing model, would proceed through (a) an overview of teaching moves within 
teaching strategies and perhaps an overview of teaching strategies in the 
context of a lesson^ (b) practice both in making moves and using strategies, and 
(c) some feedback on the skill of his or her performance in both. 

Within this general training model, there are also some evident, and 
less evident but interesting, occasions for the use of materials. In the 
first stage ot the model, for example, the use of protocol films illustrating 
specified teaching moves or strategies could clearly establish these moves 
or strategies as definable behaviors and, at the same tirae, provide an over- 
view For the trainee to gain a general perspective on teaching moves and 
strategies in the context of classroom teaching. In fact, the rationale 
for Such a protocol film series has been recently developed by Cooney, 
Kansky, and Retzer (1,975). In their very interesting monograph, the authors 
specify a selection of concepts referring to teacher behaviors, or mov^i?, 
that are instrumental in teaching specified concepts in mathematics. They 
have also produced a ^*rough draft^' videotape demonstrating the utilit' of 
protocol films In mathematics eduC£.tion, 

In the second and third stages of this training model, those of 
practice and feedback, there is another interesting opportunity for the. 
development of materials. At the National Center, there has been some 
encouraging practical success with a highly simulated training, techni- 
que that provides an opportunity for the trainee to respond under modified 
"feedback"" conditions. Working in the general area of developing .^^^.ill 
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in reaccing to pupil responseSj several associates of the Center have 
constructed pilot printed manuals and audiotapes that present bits of 
cl£issrooiu dialogue, or interrupted classroom dialoguet with actual 
teacher reactions either omitted or delayed* The trainee is required to 
construct^ in either trritten or oral forin» an appropriate reaction to 
each student response. Informational feedback is provided for the trainee 
through brief editorial comments suggesting one or more aspects of a stu- 
dent's response to consider in constructing a reaction and through providing 
the teacher's actual reaction after a delay. 

Our experience with this technique^ along with the successful use of 
comparable simulated methods by others (B&e for example Borg, 1975b), 
suggest that it is a promising training method. It Is Interesting to specu- 
late about the application of such a simulated technique to the acquisition 
of moves in teaching mathematics. For example., correct and incorrect pupil 
responses to specified teaching moves might be filmed* the trainee being 
required to construct successive or alternative reactive moves in such a 
simulated form as audio-recording. 

Let us return once more to the matter of developing films illustrating 
specific moves and strategies. As in the case of skill acquisition, there 
are certain suggestions in the literature on concept acquisition that might 
provide useful gulrJelines for design (Clark, 1971; Ellis^ 1972; Hudgins, 
1972). Xf a specified concept referring to a teaching move is to be illus- 
trated ovi a protocol film^ For example, the behavior referred to by that 
concept should initially be isolated as much as possible. This calls for 
a very brief filmed excerpt with a sharp focus on the relevant teacher 
behavior. Examples as well as nonexamples of the concept should be 
contrasted, examples predominating in frequency. The behaviors referred 
to by the concept should be varied across teachers or pupils and across 
classroom settings. Ultimately, but not Initially, the behavior referred 
to should be presented in a relatively '*noisy'* or complex setting. Obvious- 
ly, this maximizes the similarity between the training condition and the 
transfer condition (i.e., recognizing behaviors in actual classroom settings) 
Finally, the relevant attributes or Indicators of the concept should be 
'^highlighted*' as much as possible. 

Once againt of course, these suggestions should be treated as guide- 
lines rather than as prescriptions* In our own work, we have modified 
them or varied them depending upon considerations pertaining to everything 
from the dimensions oi the specific concept to the aesthetic quality of the 
film. At one time or another, however^ these varied suggestions have all 
been met in the protocol films on teacher-pupil interaction developed 
through the National Center arfd the Indiana University Protocol Ifaterials 
Project. Viewing these films does provide one or more concrete examples of 
each of the above specifications (see Gliessman, 1974). 

Implicit in our analysis to this point have been several arguments for 
the development of specially designed materials as a basis for craining. 
These might be briefly summarized*. Materials that are produced iti an 
auditory or visual format have the unique capacity of directly portraying^ 
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IngersotL, 197^). The difftculcy of dir^win;^ inferences froni^ to say 
nothing uf repl LCncing, the results of much research in teacher tr;iining 
is partially <lue to the p<Tucity of do£*crlpttons of the conditions of 
training* Matt?rials for tcairtingi bein^^ concrete and dis trlbutabiSt 
can significantly add to the descriptive detail about the training treats- 
meat* Such tn:iterials can also provide the research worker with added 
practical control over the conditions of training. 

Just as we ll--desi Joined materials can affect practice, the problents 
posed by the condLtious of practice have clear tmplicj^i t ion^ for the 
design of meteriaLs* In this paper, we have already attested to the 
difficulty of instituting any new procedure in teacher education. Con-- 
ventions of admJ nis t rat ion^ habits of instruction, and complej;ities of 
instructional service are likely to present many points of resistr^^e. 
What is surprising; is how developers of new training procedures^ and of 
materials for trninlngi seem to confo^jnd these existinj;; problems of 
implementfjtion by a lack of foresi^hi in desij;»n. A carefully validated 
set of matericils f^"r training is of little consequence If it is so volu- 
mlnotis, so detailed, or so intricate that it is iinpracuical for normal 
classroonj use. It ls prtfbably an exaggeration to say that ,i complex set 
of materials that is clearly superior to other materials for achieving 
an intended outcome will go unused hecnuse of that complexity* It is coii'- 
ceivable that a new training procedure migh*t be so demonstrably superior 
in its effects that it would be widely adopted whatever logistical problems 
ic posed* It is much more likelyi however, that we are really Calking 
about the creation <^^. materials and procedures that produce results equal 
tOi or perhaps riomewhat better thani an alternative set of materials or 
procedures* Because of this, efficiency in design becomes important. 

During the past four yearsi the author has had occasion to look 
through a number of newly developed materials for training. The impressir 
they convey is not generally positive* They are frequently too longt too 
'^home made" in appearancet and toe complexly organized to be of practical 
use* One must remember also that many, probably a maiority, of these same 
materials are unv^ilidated in terms of their stated outcomes. The general 
prospect is not reassuring. 

More systematic evidence of this kind was recently reported by three 
National Center associntes who studied the probable utility of a wide 
range of existing materials for training in insej;vice settings (ingersoll, 
Jackson^ & Walden, 1975)* Ideally, of course, such materials should be of 
particular use in inservice training because they ostensibly focus on the 
development of teaching skLlIsL As part of this study, these investiga- 
tors surveyed the conditions of inservice training (availability of equip- 
ment, space^ personnel, time, etc*) in 26 school systems of modest size 
in the midwest; they then compared these training conditions with the 
conditions apparently assumed by the hundreds of materials catalogued in 
two major reports (Teacher training products, 197^; Houston, 1973), 
Briefly, the authors concluded that the actual conditions of inseifvice 
training in the schools surveyed would make the use of many of these 
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materials highly Impractical, For example* the materials catalogued 
frequently requir<id too much training time often asi3umed the continued 
availability of space that did not exists and sometimes required a com- 
bination of audiovisual equTpf&^t^that was Probably too complex to handle. 
In addition^ these Tnaterials commonly assumed a specialised leadership skill 
that was not readily available to the school systems. Finally^ and some- 
w^fiat patentheti-cally* many of these materials were actually informational 
in nature; they serve; largely to inform or motivate the user rather than to 
provide training in a performance. 



The theoretical and practical cottsiderations to which we have beon 
Fittending are not, howover, the only factors that influence the desigft of 
materials. The specific medium with which one chooses to work is also a 
significant factor since the latitude for design is not the same across 
all media. For example* certain visual effects sometimes used in film 
(such as ^'freeze frames*' that stop motion and thus, in effect, introduce 
"photographic stills'* into a motion picture) are essentially redundant to 
filmstrlp and irrelevant to audiotape. In any event, the actual produc- 
tion of materials, the point at which a design idea is committed to physi- 
cal form, is certain to add some new dimensions co that desigft idea. 

It is only fair to point out that the area of production has its 
share of ^'traps^' for the unwary developer; he or she really does need 
the guidance of a media production specialist to traverse the area 
safely. As content specialists, we are very unlikely to have the t u h- 
nical knowledge to handle production problems with finesse and efficiency. 
Our purpose in this section is simply to raise a few general questions 
about production for Initial guidance and not to completely *'!!^ap" a 
complex area . 

What media are most effective ? Although frequently asked, this 
question is really unanswerable in a general sense. Even when care is 
taken to define what is meant by "effectiveness" (in terms of learning 
outcomes or user reactions^ for example), one will not find any 
decisive data in the literature although empirical studies addressing the 
question are plentiful (Levie, in press). Among the reasons for this 
uncertain state of affairs is the fact that any so-called "single medium," 
such as motion picture film, is highly variable across specific films 
in design components that may affect learning or viewer response, Thus» 
comparing one medium with another generally becomes an exercise in 
comparing undifferentiated or poorly described media forms. 

In short, one is not likely to find convincing general evidence on 
effectiveness that will lead to the selection of one medium over another, 
A more promising approach has been described and rationalized by Levie 
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(in press). Essentially, his la an analytic approach that calls upon Che 
developer to consider the Incerrelatlonshlps among the learner, learning 
task, and learning environment in terms of certain critical characteristics 
that are shared by the medium. At a minimum (and here his dimensions will 
be simplified for the sake of clear communication), the developer might 
analyse the skill to be learned for critical characteristics that are also 
reflected in, specific media forms. For example, if he er she decides that 
a specified teaching move has certain critical gesttiral characteristics, 
videotape or motion picture might wisely be selected as the mediuiu because 
each has the capacity to coimnvintcate visual motion. 

Although there is apparently some evidence emerging on the effects of 
differetit media characteristics, it is probably wisest at this point to 
view the question of the effectiveness of a specific set of materials as 
one for the developer of those materials to assess through catefully 
designed evaluatioti studies (flee» for example, Gltessman^ Pugh, fit Perry 
1974), Once the spectre of ''comparing media'* is exorcisedj the developer 
may even decide to /ary the design or the components of that set of 
materials to evaluate Che effect of such variation on learning outcomes. 
In this way, he or she may begin to generate more generaiisabie knowledge 
about the design of effective materials. 



Uhat are the comparative coflte of media production ? In spite of the 
logic of this analytic approach to media selection, the author^s impression 
is that most developers have a bias toward working with certain media tather 
than others. Of course, one can have more or less expensive biases, 
and that is the theme of this section. It is clear that the cost range 
of producing in different media is very great, Working through the same 
producer (who is exercising consistently high standards) and recording 
the same classroom episode, one can spend from as little as $400 for a 
finished, ten-minute audiotape to as much as $12^000 for a finished^ 
ten-minute motion picture In color with soundL Generally speaking, then, 
vfith technical standards and content held constant, it is more costly 
to produce on videotape or motion pictijre film than on audiotape or 33mni 
transparencies. 

What is equally Important to understands however, is that the cost 
range within any medium can be as great as the cost range between media* 
For example, depending partly upon whether a teacher and student in a 
tutorial session or a teacher and a total class is being filmed, one can 
spend from as little as $200 per minute to as much as $1200 per minute 
of finished film. Thus, in a real sense, most generali£ations about com^ 
parative costs of producing in different media are probably specious; 
the conditions and standards of production significantly influence the 
cost of producing in any medium. 
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Is it r&ally critical to meet high technical si:andar<^s production ? 
Tho anitwer to this question depends upon the phase of development* IC a 
developer is producing first approximations or "rotigh drafts" of an anti- 
cipated product* high technical standards should not be a primary concern. 
In fact, much of the developmeat work at the National Center has routinely 
involved the production of such rough drafts during the Eoniiative stage 
of development and evaluation* For example, prior to motion picture pro- 
duction, film outlines or scripts are initially committed to ^'hone made*' 
videotape production* At this point* high quality sound and picture is 
not a concern; content and message quality, on the other handt is* In 
fact, attending to high technical standards at this early point in develop-t 
ment Is probably counter-productive since the emphasis should be on making 
needed changes in content and design* Re*-shootlng or re-editing finished 
film is very expensive; revising *'home recorded" videotape is not at all 
expensive* 

In the final stages of development* and particularly when a decision 
has been made to distribute materials to other users, high technical stan- 
dards must be met* It is an illusion to argue that conceptual elegance or 
high content validity will make up for such technical inadequacies as an 
inaudible sound track or an cbscure picture* Materials disttibuted beyond 
the local level are almost inevitably in competition with a large volume 
of "polished"* curricular and instructional materials* What is less obvious 
is that* in distributing paterials, one is also in competition with a llfe- 
ttnie of media viewing experience by students who have lived with commercial 
television and cotiimercial motion picture* Although the conceptual standards 
of much of commercial television or film might legitimately be questioned, 
there ±s much less question about its technical adequacy* 

tJhat is the best way to generate and record examples of teaching moves ? 
There is an assumption in this question that should first be made explicit* 
This assumption is that audio or audio-visual examples of teaching moves 
are central to the development of materials for training in mathematics 
education* In other words, this question ^issumes the creation of protocol 
materials illustrating teaching moves and* perhapSt teaching strategies* 
Previously In this paper* we have noted the plausibility of such a format 
in the creation of useful materials* 

The question can be addressed most productively by rephrasing it to ask 
wJiat tire the most efficient procedures for generating and recording examples 
that (i?) are unambiguous referents of clearly defined concepts (let us call 
this chiiTacteristic ^'referential validity") and (b) are behaviorally authen* 
tic, rather than contrived or artificial (let us call this "behavioral 
validity")* With these characteristics in mind, we might assess several 
approaches to producing tape or film footage* 

One very common approach is to prepare a complete script of an 
episode that is then enacted and recorded on tape or film* For example. 
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of teaching (in this case* teacher-led class discussion) was establishedj 
again to ptovide the context for the critical teacher behaviors to occur 
with sufficient salience and frequency* Students In the film were Instruc- 
ted prior to production only in the general ^icadeniic content of an episode* 
During filming, they were free to respond to the film teacher spontaneously. 
Having no script, the flltn teacher was similarly free to develop and conduct 
Che classroom dialogue (in other words, to '^teach naturally"). During 
filming, the teacher's performance was ^Wnltored'^ for occurrence of the 
critical behavlo rs ^ reshootlng was done when necessary, 

Frotn this general footage, behavior excerpts were later drawn that 
most clearly and cleanly illustrated the specified concepts. Drawing In 
this way upon filmed episodes that had been selectively structured and 
carefully monitored resulted In a high degree of referential validity. Such 
initial structuring also increased the efficiency of filming because unusually 
large amounts of footage did not have to be recorded to obtain examples of the 
critical teacher behaviors. Finally, the latitude allowed by the absence of 
a script resulted in the kind of spontaneity that contributes to a high degree 
of behavioral validity* Thus, such an approach to filming has specific 
advantagi^s that recommend it as an effective means of generating and record' 
ing moves in teaching mathematics. 



The thesis of this p£iper Is that change In the training of mathematics 
teachers can be effected to a significant extent through the creation of 
new materials for training. More specifically, the skillful performance 
of specified teaching moves and strategies can be developed through train- 
ing procedures based on specially designed audio £ind visual materials. 
Since such training involves both conceptual and performance elements, 
implications for the design of materials were drawn from the empirical 
literature on both concept and skill acquisition. Since such materials 
must be of practical value in training, Implications for design were also 
drawn from educational practice. Finally, questions about the actual pro- 
duction of materials were explored; the comparative effectiveness and 
cost of different media, the importance of technical quality, and the most 
effective production strategy. 
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Re flections from Research; 
Focusing on Teaching Strategies 
from Varloos Directions 
Marilyn Soydam 
The Ohio State University 



Introductory Reflections 

The search for and the control of teaching strategies has^ at one and 
the same tlme^ idealistic and pragmatic goals^ The promise of and progress 
in the development of a theory of instruction is coupled with the chance of 
providing some pertinent evidence on behaviors which will help teachers 
teach more effectively^ To^ often^ research has focused on the pragmatic 
need for an answer to a specific question In a finite amount of time* That 
the idealistic need should also be served by each separate piece of research 
has been ignored* The pressure " from teachers to "give me something I can 
use tonunorrow" has concentrated attention today on materials and activities. 
How to decide when to use them — and how to teach — at times seems to 
have become irrelevant to many> Yet^ In the past decade an increasing 
number of teachers have become Interested in research^ and In what research 
can tell them about effective ways of teaching. 

Compare the reflections of teachers at two levels; the similarity of 
their need Is obvious- 

I am a tescher.. 

I teachr and children lesrn^ and 1 hardly know why.. 
I try to figure out what I do as I teach that makes 
children learn^ but I can only see some vague clues — 
but there is no pattern. ^ 

I am a teacher educator* and I suddenly realize that I know 

virtually nothing about the act of teaching* 

Oh» X can teach> 

I can show others how to teach > 

I can even tell a few things to do that probably will 
make others more effective teachers. 

I can recognize good teaching^ and know some of the things 
that made that teadiing seem good — and I can recognize 
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poor teaching, and know some of Che things that made it poor. 
But I feel as if I'm playing a game for which 1 don^t know 
the rules. 

As we rationally explore teaching strategies and aim for a theory 
of instruction, let us not forget that teaching proficiency is acquired 
in many ways. The ability to teach, the capacity for teaching, seems 
born In some: They do the "right" things naturally^ constantly varying 
their response to the stimulus that is the learner. Others learn by 
watching, by modeling behaviors, by modifying what they have seen others 
do. And others struggle just to use the *'bag of tricks" they have been 
handed in a teacher education program. All can profit from seeing the 
patterns of teaching, patterns that are collections of teaching strategies. 

Throughout the years, attempts have been made to identify Che charac- 
teristics of an effecCive teacher. There is some consijnsus Chat it is 
important for a teacher: (a) to like children, (b) to communicate with 
learners, <c) to know what to teach and Co like that content, (d) to have 
a philosophy of teaching, and <e) to understand how to teech. 

But for yeiirs, researchers in mathematics education (as well as other 
curricular areas) have seemingly been avoiding the main point as they have 
attempted to ascertain what makes an effective teacher. They explored 
the teacher*s background, the number of mathematics c es the teacher 
had taken, the age of the teacher, the number of year c experience the 
teacher had, and a host of oCher fiictors, to determine correlates of 
teaching effectiveness. Certain correlates were indeed found, such as 
warmth and enthusiasm and managerial ability. But such correlates have 
little promise as variables for controlled experimentation on the rela- 
tionship between teacher behavior and student achievement. Despite Che 
fact that in study after study limited correlations or few useful ones 
were found, the pursuit went on. 

Thank goodness we are no longer so myopic, tfe may never find strong 
correlates of achievement: Perhaps the process of teaching is too complica- 
ted for that. As Fey (1969b) noted: 

The question of predicting teacher effectiveness 
is not pimply answered by direct measurement of obvious 
variables, but must be viewed as a complex interaction of 
several interrelated classes of variables, (p. 541) 

At long last are looking at the £roce£s: is it that does go on 

in a classroom, in lesson, in a moment of teaching? What is it that 
the teacher does which contributes significantly to the student^s 
learning? Analyzing what actually goes on in the classroom, to find 
clues about what effective teaching Is, seems so utterly realistic 
that it is amazing that so much tim^ was wasted in not doing just that. 
Perhaps we will find out more about how to teach teachers to teach, with 
the ability to understand why cercain teaching procedures work and the 
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capability of generating more effective strategies. Perhaps wi? will find 
out how to pre^llct what will happen under specified conditions^ £jo X-hat 
we can select strategies that will ensure learning, {Howeverj we must also 
keep in mind as we observe what goes on in the classroom that what teachers 
do may not be what teachers should do . For Instance, Brown (197^) reported 
a very heavy dependence on the textbook by the 42 algebra teachers an<l their 
classes whom he studied. Mathematics became a sterile sequence of homework, 
discufisloHj and new ho^sworlc, ) 

While the search for what makes a teacher effective pursued its 
course into the teacher's background, other research with a different goalj 
ignoring the specifics of the teacher- learner exchange , explored comparative- 
ly more general areas: what content to teach^ whether to use this algorithm 
or another^ or the effects of alternacive methods. Teaching strategies 
were implicit in each^ but usually only generally or globally defined. Many 
times, in one way or another^ it was ^'concluded'* that the teacher made the 
difference, that almost any alternative proc^;dure is effective when employed 
by a good or effective teacher, (What a gord or effective teacher Is, how- 
ever, was undefined,) 

We have confirmed many things with these studies. We can point to 
research and indicate to teachers certain things that research has made 
evident. Some are specific; for instance, algorithm A promotes achieve- 
ment better than algorithm B, We have also confirmed the effectiveness or 
appropriateness of many procedures which can be generalized almost as 
"rules*': 



1, Plan systematically, 

2, Base Instruction on the readiness of pupils, 

3, Croup pupils and have pupils teach each other* 
A* Teach with meaning, 

5, Teach for transfer*. 

6, Motivate and pr..lse. 

7*. provide practice following understanding*. 

8^ Spend 4^t least half of the clas^ time on developmental activities, 

9, Use concrete tnaterials before proceeding to abstraction* 

10. Provide periodic ruvlew and spaced practice* 

11* Diagnose errors and provide instruction on the basis of diagnosis, 

12, Teach a variety of problem-solving procedures* 

These obviously do not combine to form a theory of instruction. In 
fact^ only recently has there been serious recognition of the need for a 
theory of Instruction and a serious attempt to develop and find evidence 
to support a theory of instruction. Among the various attempts in mathe- 
inatice education to develop such a theory, are two which are attacking the 
problem from different directions. The work, of Helmet and his students 
(Helmer & Lottes,. 1973) Is an effort to define sequences of instruction and 
the variables related to sequences which affect learning ^ j^enerally at the 
elementary-school level and highly related to learning outcomes such as 
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transfer and retention. Our concern is with the other instance^ the work 
of Henderson and his students who define strategies of teaching and 
variables related to teaching strategies which affect learning* generally 
at a post-elementary-^school level* Mention is made of the existence of 
the two approaches In order to point out tvo facets which they have In 
cormnon. In botb Instances* a model ^nr the research has been rationally 
developed, and the attempt to conflnn and expand portions of that model 
is being made through a set of coordinated studies. These two facets alone 
are firm steps forward In educational research. 

Dossey (In this monograph) provides a concise presentation tracing the 
development of relevant work on teaching strategies as defined by Henderson's 
model for teaching concepts* He gives an excellent sumuiary of the status 
of thought and research on the topic. He has excluded some studies not 
relevant to his purposes (e.g** Cooney* 1970; Wolfe^ 1969) in order to 
focus on those studies which have tested the utility of Henderson's models* 
Oossey's questions are valid ones; reflections of them will arise elsewhere 
in this paper. 

The extension of the model he proposes holds some promise for coordi- 
nating future research efforts. The model needs further specification* 
for exanrple^ specific content and/or grade/age levels need to be Incor- 
porated* If re&earch Is to be effective at developing a theory, each 
Study must be defined precisely in terms of its relationship to any other 
study based on the model. Merrill and Wood (l97^) carry this one step 
further^ they proposed that every study should be related to every other 
study through clear specification of each component. Coordinated planning 
nnust Incorporate all aspects of a model, and a model must explicitly in- 
corporate all aspects of concern in research. 

In addition to further research, there is also a need for (exact) 
replication of studies* Dossey makes this evident as he attempts to 
compare the Rector and Henderson (1970) and Dossey (l972) findings* The 
strategy not used by Rector accounted for the differences in Dossey*s 
study. There Is no way of determining the meaning of this difference or 
the stability of any findings unless a study is conducted which parallels 
a given study* He also attempts to compare the findings of Rollins (1966) 
and those of Gaston and Kolb (1973)* Too many variables are being changed 
at once* In the attempt to "prove'* the model or theory as quickly as 
possible* we must not lose sight of the need to Interpret and Interrelate 
findings* There are two distinct aspects of research related to strategies* 
and We need information on ea^h: (a) What goes on in the classroom between 
teacher and student as specific strategies are manipulated and (b) is there 
a relationship between what can be observed and pupil achievement? 

There are literally a horde of variables which must eventually be 
considered* These variables must be built Into the model In some way and 
explored systematically. Many are noted in other papers of this monograph: 
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for Instance* timing or pacing of instruction, ability level of students, 
characteristics of students Ce-g-t learning style), and type of content. 
There ^ire many questions to consider as the research model Is expanded atid 
as each Individual study is designed- Not all questions can be answered, 
but the problems Implicit In their formulatloti must be recognized. 

Reflections from Researcjt 

It is frequently true that a research study will raise more questions 
than ic answers. Let us consider some studies which have been selected 
because they provoke some questions which should be considered in conrec- 
tion with research on teaching strategies. All are drawn from the set of 
studies on mc^thematics education, Quality was not the determit^lng factor: 
Some studies have obvious "faults,'* and may have been selected for pre- 
cisely that reason. Each study and/or the findings from it are briefly 
described to define the setting from which the question arises, Hope- 
fullyi the source of and/or the reasons for the questions will thus be 
apparent* Some of these questions are stated for emphasis of points noted 
elsewhere in this monograph. Some poirtt out the need or advisability of 
considering certain variables which are not explicated in other papers. 
Some cannot be answered by research, while some could lead to researchable 
problems. There is no attempt to raise all of the questions which might 
arise from a cited study; rather, one two which might cause the reader 
CO develop others are posed* 

Not unexpectedly, many o£ the studies cited involve some form of inter- 
action analysis Ce,g*, studies 1-12)., As researchers have tried to analyze 
what goes on in the classroom, various instruments or procedures have been 
developed and used. Until systematic procedures were devised, in fact, 
^attemprs to analyze what happened in the classroom were rather confusing* 
Research with these instruments has added to our knowle<jge of classroom 
occurences, though it must be kept In mind that what is "fouod" is a 
reflection of what an instrument or procedure allows to be recorded. 

Since questions are one of the valued techniques for teaching, evidence 
ott what types of questions teachers ssk is useful* Some studies of teacher- 
pupil Interaction which focused directly on the type of questions are cited 
Ce.g,, studies 13-17)* 

Ono study (is) uses a computer to simulate a teaching incident. 
Studies related to Henderson's model have moved from use of programmed 
instruction as the teaching mode to study of the teacher in Che classrootti* 
Use of either creates certain problems. With programmed Instruction, there 
is precise control of the strategies, but the interaction is also controlled 
— and limited. With the actual teacher lo a classroom, that very inter- 
action can mean less control of the strategy being used* CAT is proposed 
as an alternative, or as an intermediate stage betweeri Programmed iFistruc- 
tion and '^livet^' interactive classroom instruction. 



ERIC 



194 



-190- 



Embedded in the teaching strategies proposed by Henderson, and 
explicated more extensively in some studies (e-g-, studies 19-21), is 
the use of none>ianiples and coi^nt erexamples ^ They point out a particular 
problem, one of definitions. A lack of agreement on definitions or use 
of terminology plagues much research- The meaning of the terms "non- 
example" tind ^'counterexample'^ is present<id by Henderson (1967), 

Nonexample: An object which is not a member of the 
referent set (that Is, not an example) Is designated- Usually 
this move is employed when experience has shown that students make 
errors based on not knowing certain necessary conditions. 

Counterexample: An object is named (or otherwise designated) 
that falsifies a generalization purporting to characterize 
rhe m<inibers of the referent set. This move is used after a charac- 
terizing move and is never the first move in a concept venture, 
it is often x^sed to enable a student to correct a misconception*, 
(p. 576) 

These definitions may be clear; but all researchers have not made this 
distinction in their tjse of the terms. To confound the situation more, 
a third term "negative instances" is also used, probably as a synonyn for 
nonexampie, bxit possibly as a generalized term to cover both nonexamplec 
and counterexamples. This makes research on this facet somewhat difficult 
to interpret, particularly in cases where specific illustrations are not 
included in a research report, 

Now let us consider the selected studies and some questions. 

Study 1: Options from Organization 

With a statement about the nature of teacher-student interaction, 
Hudgins and Loftts (1966) described the options of: students and teachers 
in the classroom: 

Interaction in the classroom occurs lender special conditions 
that set it apart from interaction in other kinds of settings*. 
In most cases the teacher originates the interaction. The 
teacher has the prerogative of raising questions, setting 
taskSj and evaluating behavior independently of the desires 
of pupils*. In the arithmetir class the teacher is free to 
demand interaction with any pupil at any time, but the con- 
verse is not altogether true. Usually pupils interact with 
the teacher only vhen, in effect, the teacher signals that such 
interaction is permlssable*. tfhile interaction in the classroom 
can be initiated either by the teacher or the pupil. It Is 
Important to remember that pup 11 -^Initiated interactions are 
contingent upon teacher sanction* (p, 146) 
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In twelve fifth- and sixth-grade classroomsj Hudgins and Loftls 
studied 11 "visible," 11 average, and 9 "invisible" students. ("Visible" 
and "invisible" students were high In arithmetic achievement, but differed 
in the extent to which peers recognised that ability.) It was found that 
the students did not differ in the average number of interactions with the 
teacher or in the feedback they received from the teacher. The teachers 
appeared to be remarkably consistent in distributing interactions equally 
among students and in evaluating student responses*. Visible and invisible 
students initiated interaction more frequently than the average students 
did, but teachers tended to compensate for this difference by initiating 
interaction more frequently with average students than with the visible 
or invisible students. 

Questions : Ha^ does the way. in y>hioh a classY*oom is ovganized affect 
the type and quality of teacher^ student interaction? What type of ovgani- 
nation is ifnplictt in each Hendevson~oviented study an strategies? 



Study 2. Teacher Awareness^ 

Strickmeier (1971) attempted to (a) describe and compare patterns of 
teachers' verbal behaviors in seventh-grade mathematics classes grouped 
by ability and (b) determine if seventh-grade rtachematics teachers have 
different perceptions of their verbal behaviors and different expectations 
of student behaviors for classes of different ability levels. He had 
teachers complete a questionnaire concerning their expectations of behavior 
within each class, and then he observed each teacher three times with a 
high-ability class and three times with a low-ability class (using the 
0 ScAA-5V ). 

Analysis of the data revealed chat the teachers did have different 
perceptions and expectations for the classes of different ability levels. 
But despite these differing perceptions and expectations, teachers* 
behaviors were not different for the classes at different ability levels. 

Questions / What relationships do and/or should exist between teachers* 
expectations and their choices of strategies? What student characteristics 
should be considered hen selecting samples? 



Study 3: More on Teacher Expectations^ 

Kester (1969) fotind by observation that seventh-grade teachers communi- 
cated with their allegedly bright pupils in a more friendly^ encoura^^in^.. 
accepting manner. As che pupils^ positive communication to the teacher 
increased^ the teachers' communication to the pupils tended to be positive* 
Teachers also spent more time communicating with them*. Nevertheless, pupil 
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achieveniet\C was ^ot significantly affected. 



Qii&aticn: Ha> dees ths'^oy invhioh cl teaaher vie^o &ach student 
affoKit the strategies fov and responses of that student and ^he class? 



Study 4; Training for Interaction 

Smith (1971) worked with a group of preservice elementary teachers. 
They defined ev^iluation and discussed its purposes, formulated guidelines 
for observing classes* observed end discussed filmed les^ons^ cooperated 
in the development of observation instrument^ and independently used 
it while observing six additional films of elementary mathematics teach- 
ing. Then they were observed while teachings using the Adapted QScAR-(EH) , 
Smith reported a greater frequency of (a) use of Identified vocabulary* 
(b) pupil-teacher interaction, and (c) total strategies. Smith concluded 
that these could indicate that the treatment experiences might have carried 
over Into the classroom. 



Questions : Whot types of experiences should be given to teachers to 
make thm a^ore of fa) the role of teachei^pupit interaction and (b) hcu 
to develop effective teacher^ pupil interaction? fiight it be that what is 
ijnportant is not the particular tsohnique used with teachers^ but the 
development of an understand-ing of teacher-pupil interaction and of 
teachi>ig itself? 

Study 5; Effect of ^'Effectiveness " 

Dimeolo (l969) reported that students in grades 3 through 6» Vfith 
highly effective teachers, did not diffet significantly in their mathe- 
matical achievement from students with less effective teachers, (Teacher 
effectiveness was determined by differences In teaching patternsi as 
measured by the C5SSj!£t which were related to pupil gains in mathematical 
computation* ) 



Queetionj^ What variables and/or definitions affect a research study 
so that %t appears that students achieve equally well with highly effect%ve 
and less effective teachers? 



Study 6: Student Participation 

Robitaille (1969) provided evidence that the effective mathematics 
teacher at the secondary level seeks to increase the level of student 
participation in the lesson significantly raore often than does the less 
effective niathematics teacher* 
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QmsHon : What t-s thi? relationship betu^en amimt of student partis 
cipdtion an<r(^MCility of student p(u*ticipation? 



Study 7: Allocations 

Stilt^ell (1963) studied tht behavior of twelve inservice secondary 
teachers during problem-solving activities in a geometry classroom. A 
sixtceti-category Instrument was developed, with ten categories for teacher- 
talk, four for student-talk, one for sttuctured silence, and one fot non- 
classifiable activity. Analysis of the data showed the following: (a) 
teacher-talk consumed approximately three tln»eo as much time as student- 
talk; (b) less than three percent of all time in problem-solving involved 
the activity described as "method for solving ii pro*blem"; (c) approximately 
el{^ht percent of all tittie was coded as structured silence; (d) looking 
back at the solution or looking ahead to its Implications consumed apptox- 
tmately seven percent of the time; and (e) behaviors In only three of the 
twelve classes observed differed significantly when engaged In review or 
In introduction of new content. 



Question : What percentage of time i^ "appropriate" for mathematics 
teacher's to spend in each category for a given type of mathematics 
activity? 



Study B: Classroom Climate 

Vayda (1966) had fourth-graders work on problem-solving tasks* To 
analyze group performance^ he u^ed VJithall's Social'Emotional Climate 
Index , t^hlch categorizes teachers' verbal statements and classifies them 
as predominantly learner-oriented or teacher-oriented. The classes of 
teachers who were learner-oriented (a) demonstrated more effective gtoup 
planning, (b) demonstrated greater autonomy in conducting planning dlsc^jssions^ 
Cc) formulated more precise plans of action, (d) were more efficient and 
successful in solving the problem, and (e) bad gteater congruence between 
plans and actual apptoach used. 

Questions : Haj does the socials emotional climate affect the teacher* s 
choice of strategies and the students* responses? Should climate 
considered in the model? 



Study 9: ^^oves and Strategies 

Fey (1969a) developed tin instrument to describe both pedagoglcally 
and mathematically significant components of teacher-student interaction. 
Four iJessions each of five different classes were tape-reco tded and the 
recordings wete transcribed* Each transcript was partitioned into a 
sequence of moves which were then described according to soutce; peda- 
gogical purpose (strutturlng, soliciting, responding, or reacting); dura- 
tion; niathematical content; mathematical activity (developing, examining 
or applying a mathematical system); and logical process (analytic, factual^ 
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evaluative, or justifyinfi)* He found that: (a) each teacher spoke more 
thaxi all of his students; (b) each teacher dominated tho pedagogical 
functions or structuring (80 percent of these moves), soliciting (95 percent), 
and reacting (85 percent), leaving. responding as the major student activity; 
(c) over 50 percent of all moves were statements or questions of facts, 25 
percent vrere evaluations^ and the remaining moves were divided bacveen 
justifying and analytic process; (d) content emphasis in all classes 
followed closely the sequence of the textbook chapter being studied; and 
(e) teacher influence in shaping the direction of classroom activity 
differed from class to class, but the difference was primarily one of 
degree rather than kind* 

Question t l-Jhat is the correspondence between Fey and Henderson- 
oriented studies on (a) definitions of m>ves and strategies cmd (b) 
niarbers of moucB ancl strategies cbserved? 



Study 10: Grade/age Level 

Mahan (1971) used a system of verbal analysis based on Smith and 
MeuX^s (1970) categories, adapted to suit the level of kindergarten dis- 
course. Eleven basic moves were included; Characteristic, Classification, 
Analysis, Analogy, Differentiation, Instance Comparison^ Instance Pro- 
duction^ ^Positive Instance, Substantiation, Negative Instance^ and Non- 
cod.ible* Analysis of tape recordings revealed }.19U Interactions in the 
16 lessons tsught by four student teachers. Descriptive language accounted 
for ^5 percent of the interactions. Comparative actions were least used 
(11 percent), Instantlal moves were used in ^1 percent of the discourse. 

Patterns were based on blocks of nine sequential moves and identic 
fied according to seven types. The mean was 33 patterns used by each 
student teacher. Type a combination of Descriptive and Instantlal 
actions^ was most frequeatly used. 

Questions t Ha^ do strategies used by teachers at different grade 
levels differ? W}iat is the role of patterns in relation to strategies? 



Study 11: Balance of Moves 

BelLack^s (Bellack, Kliebard^ Hyman, S Smith, 1966) scheme was used 
by Cordis (1973) to describe the interaction in four first-grade classrooms 
during instruction oa serial ordering. The teacher dominated the discourse 
by moklny* two-thirds of all moves as well as most of the initiatory moves, 
89 percent of the soliciting moves, and 95 percent of the structuring moves 
Pupils maile 92 percent of the responding moves and teachers 74 percent of 
Che reacting; moves. It w^is also noted that simpler cogaitive actions were 
more likely than more complex ones to be fonnulated in operational language 
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This latter finding was interpreted as giving evidence that evaluation 
of language usage coidd Teveal the developmental level of children's 
thought ^ 

Questions : It^at factors can change the percentage of monies in each 
category? Ua^ do lar\guaq& and content interact with teaching stx^at&gy? 



Study 12: Lan^ua^e FatCerns 

Gregory's (1972) major objective was to determine the relationship 
between the frequency of use of the language of conditional logic by 
mathematics teachers and thelt seventh'grade students' conditional 
reasoning ability. He au<liotaped each of twenty teachers* classes five 
times and administer^id a reasoning test to students at the beginning atid 
end of the semester. The teachers were ranked on the basis of analysis 
of the frequency of theit conditional moves, that is, how often they 
used "If-then" language in their teaching. Students of teachers who 
more frequerxtly used such langauge outperformed students of teachers who 
made fewer such statements. Thus teachers, through the use of logical 
language in a variety of situations, apparently helped students to 
develop greater achiev<*ment In the aspect of logic considered, 

Questions : Does having t^aokers focus on specific types of language 
help students in achieving certain educational goals related to that 
language? What language patterns do tmchevs use? \^at is the effect of 
these patterns on students' performance? (As one exanjple^ if ^ome teachers 
use many nonea^cunples ^ do their students tend to use more nonexamptes 
in their ojn thinking^ or uhen discussing mathematics?) 



Study 13: Level of jjuestioyxs 

Meckes (1972) studied teacher-pupil interaction and teachers* ques- 
tiorxing patterns for mathematics in grade 6, A tape recording was made 
of one class session conducted by each of 100 teachers. Ten-minute seg- 
ments of each tape were analysed, and all teachers' questions were trarx- 
scribed from the 100 tapes and classified into one of seven categories 
in the Taxonomy of Mathematical Abilities , Meckes stated: 

The results obtained from the Flanders Interaction Analysis 
appear to indicate that the role of the mathematics teachet has 
not changed from that of giving information to that of guiding 
learning experiences. This conclusion was supported by the follow- 
ing evidence: The teacher spent 61,5 percent of the time talking. 
Direct Influence accounted fot 50»2 Percent of the teacher talk. 
Although influence amounted to 49,8 percent of the teacher talk^ 
the largest portion of this was in the questioning category* Since 
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mosE at these questions were very narrow, they provided 
little opportunity for students to express their own 
ideas, (p, 4246) 

Although one of the primary objectives of naw mathe- 
matics ts to foster a spirit of inquiry and to develop creati- 
vity, only ^5 percent of che total questions were placed in the 
synthesis category. The two low cognitive level categories 
accountetJ for 79^5 percent of the questlc?ns asked, (p, ^2^6) 

Questi^ : Could/should ths level of teaahsj^ questions bs inaovpor^ated 
as CL ditusnsTon of ths teaohing ptovs or" strategy? 

Study 14: More on Levels 

Friedman (1973) attempted to develop a system that would describe 
the extent to which teachers seek two Important goals of a geometry course; 
eliciting high levels of student thought and learning the nature of proof. 
He also investigated che relationship between a teacher^s questioning 
behavior and the performance of his students on a test designed to assess 
understanding of the nature of proof and the ability to thit^k on various 
intellectual levels. 

Thirty-five lessons taught by 15 teachers were tape-recorded as a, 
geometry theorem was beit^g taught, ,The coding was by teacher's question 
and by mathematical activity*. The median percent of questions at the 
memory level was 23^ considerably less than the percentage typically 
asked by teachers of other subjects. Comprehension questions were asked 
more frequently than other levels of questions; the median was 56 percent. 
The median percent of application questions was 18, Of 1841 questions 
asked, only four were higher-level questions^ and only twenty it^volved the 
nature of proof. 

The frequency of che application questions a teacher asked In class 
was positively associated with student performance on test Items at 
the applications level.. For the other types of quastions^ however^ che 
number of questions a teachec asked appaared to have no clear relation- 
ship to student performance on test items of the same cognitive levels 

Questions : Hew does the level of question intevaot with the specific 
content being taught? Is there a relationship between the findings of 
studies like this one and a studif on tmohing st^tegies such as Shank's 
(see Sbank's paper in this monograph) ^ in which test items u^ere at 
different levels? 
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Study 15: Concent Effect 

Kysilka (1970) obsatved 2U teachers (six each la eighth- and eleventh- 
gtade mathematics and social studies) fout times, tecotdlng. their verbal 
behaviors with the QScAR-5V , Among the findings were; 

1- Mathematics teachets asked mote convergent and fewer divergent 
questlonSi uded inote ptocedutal-po3l tlve questions, and made mote diteccii^g 
and describing statements than did social studies teachets. 

2, Mathematics teachets talked significantly more than did social 
studies teachers. 

3, The proportion of pup 11- Initiated statements to teacher state- 
ments was significantly gteatet In social studies classes than In mathematics 
classes* 

Qu&sti^a i H(W much conby^ot does (or must) the content exert on the 
patterns of %nteraction used by a teacher? Ave there some behaviors which 
teachers exhibit in other content areas tJhich could and shouldbG applied 
to the teaching of mathematics? * 



Study 16; Training fot Questioning 

In a study with 30 science and mathematics teachers, Adhikaty (1973) 
gavG the expetlmental group an Instructional ptogtam requiting the students 
to wotk through a programmed instruction unit on classifying teacher ques- 
tions, discussing the use of different types of questions, writing questions 
in lesson planning, and discussing teasons why students do not answet teachets* 
questions- The teachets* quest ion- as king behaviot was changed following this 
insttuctlon. They used mote convetgent> divergent, and evaluative questions^ 
and fewer cognitive-memory and managerial questions than did those who had 
not had the instruction. 



Question : Hao does instruction on question- asking interact with 
insbmation on teaching strategies? 



Study 17; Effect of Microteaching 

Klsbet (197^) used microteaching with audlotaplng to help secondary 
mathfimatics teachers significantly increase their percentage of use of 
application and analysis questions. 

Question : To what extent can nticroteaching experiences be used to 
improve the nunher, ^yp^^ and quality of moves and strategies a teacher 
uses? 
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SEudx 18: Trd lnl Tife Via C M 

Flake (1974) explored the feasibility of using interactive computer 
siinulatlons Co sciisIlIzc preservice secondary machematics teachers to 
various quesLJoning stracegies. Programs were developed for lesson planning, 
Henderson's moves and stracegieSj Polya^s approach co problem solving^ and 
a ftimplified learning theory. Kltieceen of 25 students increased their 
bfhavior of modeling the prescribed problem*solving strategy; 22 demonstrated 
an Increase In going beyond Che first responses of a student. 

Questions : What are the advantages of ueing CAT over (a) pi^grajmed 
instruction and (b) actual classroom ctservaticn? Is it plausible to 
consider use of CAT as an intermediate stage between the other tuoF Does 
the use of CAI i^esutt in findings that do not apply when a teacher is using 
the sarne strategies? 



Study 19: CounCerexnmples for Justification 

Wolfe (1969) investigated the verbal activity of justification as it 
is carried out In the classroom by secondary mathematics teachers. Record- 
ings of 23 class sessions of 11 teachers were analyzed. Eight strategies 
were identified: six strategies of validation and two strategies of 
vindication, A finding from the data is that the use of counterexamples 
to disprove a universal generalisation was noted in six percent of the 
ventures. This may be compared with the use of other types of justification: 
subsuming geni^ral ization, 33 percent (the most frequently used justification 
in algebra); deductive prooEj 23 percent in algebra, 38 percent In geometry 
(the most frequently used justification in geometry); one or more supportlttg^ 
instances (the most frequently used justification in general mathematics); 
and pragmatic reasons^ 12 percent.. 

Question : HoJ does this reflection of the actual use of aountep~ 
exanrples reflect th& relative i^ftportance of their role? 



Study 20: Importance of Nonexamples^ 

Sheppard (1972), in a study with 160 fifth-graders, reported that 
(a) giving divergent examples was superior to giving convergent examples 
and (b) giving matched nonexamples was better than giving nonmaCched non^ 
examples. Examples vere "divergent If all three irrelevant attributes were 
varied and convergent if one irrelevant attribute was varied. NonexampJes 
were matched if one or two attributes were varied and unmatched if four or 
five attributes wete varied*. The dependent variable was the comparison of 
the student's generallzntion-discriiuination pattern to four predicted pat- 
terns. 
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Que^Hons : Hcu> does this specification of type cf example compare 
with definitions of other research? Haj oont^nt^ specific a^e the 
findings on the use of nonessamples? 

Study 21: "Negative Instances*': A Conf Irxoatlon? 

Shumway (L971) designed a st^idy to determine whether an extensive 
treatment of cotinterexamples (* nonf^xamples'* using Henderson*^ (1967) 
definition) In the development oi certain mathematical concepts In 
grade 8 would result in significant differences In loean scores on tests 
of (a) general niathejnatlcs achievement* (b) specific mathematics achieve- 
ment, Cc) Inductive reasoning, (d> syllogistic reasoning, (e> reading mathe- 
matical definitions, and <f) tendency to overgenerallze. The study was 
conducted for 65 class periods with 8^ students It^ four classes; content 
Included quadrilaterals, exponents, and operations. The experimental 
treatment contained an equal nundjer of positive examples and counterexamples 
(nonexamples) , The control treatment contained only positive examples. The 
use of counterexamples (nonexamples) was found to have a significant effect 
on students* tendency to overgenerall^e the properties of operations, 

Shumway (1972, 1974)* using CAI as the Instructional mode, has also 
found that the use of negative Instances (inonexainples) as well as. posi- 
tive Instances (examples) resulted In higher achievement than the use 
of positive Instances (examples) alone* 



Questions : What is the correspondence between the definitions of 
"aonaepf'^nd "strategy used in these studies and in the Henderson 
studies? Wkat^ if any^ effect does the focus on teaming rather than 
on teaching have? Does the comparatively nonve:)i?at presentation used 
in the CAI studies affect achievement? 



A Comparative Comment 

Doseey (In this monograph) sutmarlaes a study he conducted which 
involved the use of examples and nonexamples in teaching disjunctive con- 
cepts (see pages 68-74 of this monograph) v The example approach, in 
which the mix uas one nonexample to two examples, was more effective in 
promoting student acquisition of disjunctive concepts than the non- 
example approach, m which the mix «as two nonexamples to one example* 

Dossey's concern Is obviously different from Shuwway's, Dossey 
might label his treatments '^example** and nonexample*" but he is actually 
concerned more with the question, ^'What Is the ^best' number of examples 
or nonexamples to use?'* He accepts the efficacy of using nonexamples* 
Shumway, on the other hand. Is asking, "is the use of nonexamples help- 
ful to students?** 
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The two studies each carefully controlled this variable, but on other 
variables their design differs* In his original study, ShuDJway (1971) con- 
ducted his research in a classroom setting, with teachers-pupil Interaction 
uncontrolled on dimensions other than the independent variable^ In later 
studies, he used a relatively nonverbal approach on CAI, with mathematical 
sentences being the mode of query. Dossey controlled the teacher effect 
by using programmed Instruction. Comparisons across the Shumway and Dossey 
studies could be Interesting because c>f these varying modeSv 1^ they had 
been attacking the same question. 

A serious limitation of Dossey's study is that the disjunctive con- 
cepts were contrived. In the studies Shumvay has conducted on CAIi a 
parallel limitation arises, as students react to content which may appear 
similar to knowji content but actually Is different* The transfer to reality 
is reasonable, but exploration with ^'real'* content Is also needed. 

Comparisons can be interesting. Using what we learn from them, we 
can design studies that avoid previous problems. Sometimes we can even 
put results together and find verification for findings that is stronger 
because it comes from varying sources. 



Comments on the Questions 

The questions which have been raised in this section only begin to 
tap the reservoir of questions which could be asked. Some are very speci- 
fic and can be answered by analysis or investigation. Some might provoke 
the design of a study. Some were intended to indicate concerns that 
do not at present appear to be reflected in the Henderson-oriented 
studies. In generali such factors as the organization and climate of 
the classroom, the awareness and expectations of the teacher ■ the 
type of training for Interaction and questioning, the amount oE student 
involvement, the time allotted, the age/grade level, the specificity of 
definitions, the type of language used, and the content selected for a 
study represent a few of the many facets that must be considere^I in planning 
research. A model for research on teaching strategies should make provision 
for them, especially so that continuing, coordinated research ean be planned. 



Swank's paper (in this monograph) provides an opportunity to consider 
several specific facets of one study. He presents an example of a study 
that is carefully delineated and conducted which investigates <a) whether 
regulating the amount of content information contained In instructional 
strategies Is a significant factor affecting student achievement and (h) 
the effect of teacher-pupil verbal Interaction on student achievement ^ 
The points to be cited with reference to his study are ones which are 
Important to consider as other studies are designed. Some of the questions 
In the previous section might also be applied to Swank's study (e.g.. 



Deeper Reflections on One Study 
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see questions for stwdiesi 1, 3, 6, 7, 9, 11, 13, 14, and 15)* 



Selection of Topic 

Swank met the ptimaty criterion to be considered when evaluating 
research: Is the study attacking a question that Is significant and worth- 
while? His study Is related to other Henderson-oriented studies. Investi- 
gating a facet of the model not before p*'udled, and In addition Is related 
to a question of concern In teaching aside from Its relationship to the 
model. 



Specification of Variables 

In Swank's study, as Is frequently the case In research, che deflnl' 
tlons of many variables are presented operationally* This Is generally 
more than sat Isf act i^ry for a given piece of research, and In some Instances 
promotes repllcatiovt and/or Interpretation across studies* But there are 
problems in that the definitions do not always allow for the scope of 
reality. Consider, for Instance, the "amount of content Information" 
which Is iiescrlbed In Swank's study by the number of content moves* Are 
all units of content information actually equivalent? Is It possible to 
make ^ number of concept moves under one strategy and X number under 
another strategy — and thus affect the level of learning? 

For the sake of the precision of operational definition, researchers 
must describe the variables within bounds — but let us recognise that 
we are at the same time placing limitations on the findings* On the whole, 
however, the variables are clearly defined In this study, as are the hypo- 
theses* The design Is clear. Incorporating many factors of concern* 



Assumptions 

As he investigates the effect of teacher-pupil verbal interaction 
on student achievement. Swank states an assumption attributed to Snow 
that *'the probability that students are cognltlvely Involved is directly 
proportional to the amount of overt participation**' Are we then assuming 
that students do not learn from merely listening? Should we use verbal 
responses as the only measure of cognitive involvement? This question 
also pertains to studies other than this one; such assumptions 
must be logically analysed* 



Student Characterlstlcfe r 

The premise in this and other studies appears to be that the same 
type of interaction and the same content are suitable for average and 
high achievers* But might it be that the moves and strategies used in 
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the study were actually more appropriate for the high achiever, and thus 
the results were influenced by this? Perhaps we need different strategies 
for different studectts. We verbalise the need for different approaches in 
teaching low achievers; we need to consider {and apply) far more understanding 
of Individual differences as ve design research and as we teach. 



Control of Variables 

Only one of many instances of careful control of variables in Swank's 
study will be cited: daily monitoring of the audiotapes* This assured 
that Che treatment strategy was being implemented and is certainly a sound 
research technique. If the variables in a study are not well-controlled, 
the findictgs cnay be invalid or, at best, must be Interpreted with care* 
Hany studies are open to this criticism* Sometitnes better control Is un- 
feasible or impossible* At times, however, researchers overlook details, 
such as monitoring the lessons, that are quite possible. 



Data Preaentation 

Swank's presentation and discussion of the data are carefully done; 
each finding is discussed and the conclusions are stated without over- 
generalisation. Presenting data is often well done In a research report. 
The discussion of the results and statements of conclusions are not so 
often done well; There is Q great tendency to go further than the data 
warrant. When It comes to stating implications^ some researchers manage 
to present everything they believe — although these things may be far 
removed from the study being reported. This is particularly of concern 
since so often the relatively naive reader assumes that these are results- 
from the research. 

Swank's study, despite limitations, warrants replication and extension 
to other types of content and other types of knowledge* Subsequent studies 
related to Swank's work might consider the various questions Identified 
above in the previous discussion* 



No attempt will be made to state conclusions or to summarize* Instead, 
five reflections will be restated — points that must not be forgotten as 
we explore teaching strategies; 

1. Te^tchers are individuals, and learn to teach in many ways. To 
analyze the process and to attempt to follow the analytic model may be the 
best way for some^ modeling behaviors they see another teacher use may be 
the most effective way for others. Perhaps there are some teachers for 
whom specifying strategies is of more help than it is to other teachers* 
This factor must be considered as we select teachers for participation in 
research studies. 



Last Reflections 
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2, The reason for the focus on verbal behaviors Is obvious — but 
let us not completely overlook nonverbal communication. The facial expres- 
sions, the tone of voice, the rapport between teacher end learner all are 
Iroportant, Perhaps ^'rapport" la the ultimate Ingredient oi effective teach- 



.3, Many things aid in making a teacher effective — things like the 
teaching/learning environment, creativity^ knowledge, ability to evaluate 
one's own behaviors, love of children, love of teaching — in addition to 
command of strategies, 

4, What may be an effective strategy for teaching mathematics at one 
level laay not be appropriate at another level. Further, It has been 
observed that some moves are not possible with certain types of content, 
At this stage in the research process, let us be specific in stating what 
we believe may be the limits of generallzabillty for use of specific moves 
and strategies^, 

5, As wfj concentrate on teaching ^nd the teacher, let us not forget: 
<a) the learner, <b) the context or environment, and <c) assumptions 
about each that mu^jt be made, For example, consider discipline and 
readiness, Teachr^rs cannot teach effectively, no matter how well they 
can manipulate teaching strategies, if the learner does not want to or 

is not prepared to learn, 

6, Let us continue to be systematic In the way we vary the different 
aspects related to strategies, Let us be careful in selecting and precise 
in defining the strategies being used, the content being taught, the 
environment In which the study Is conducted (both school factors such as 
organizational structure and classroom factors such as the type of materials 
available), the attributes of the students being taught, the measures of 
student performance or learning, A description of the teacher aside 

from the treatment he is using and samples of the lessons and materials, 
rather than general descriptions which can be interpreted in varying ways, 
would also be helpful, ^ery rt^search report should contain a concise but 
comprehensive description of any of the aspects of the research situation 
which might be pertinent. 



Ing, 
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